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ABSTRACT 


Software  development  organizations  are  among  an  increasing  number  of 
companies  turning  to  outsourcing  as  a  strategy  to  improve  cost  control,  product  quality, 
product  development  schedule  reduction,  and  focus  on  core  business  activities. 
Outsourcing  consultants  promise  all  of  these  benefits  and  more,  but  nearly  thirty  percent 
of  all  outsourcing  relationships  end  in  dissatisfaction.  In  response,  several  authors  have 
published  suggestions  for  successfully  using  outsourcing  to  meet  goals.  These 
suggestions  are  based  on  anecdotal  consulting  experience  and  do  not  clearly  identify 
whether  those  experiences  are  relevant  to  specific  domains  or  organizational  goals. 

This  research  effort  expands  upon  the  anecdotal  software  outsourcing  literature  by 
employing  a  broad  survey  to  identify  the  types  of  outsourcing  strategies,  their 
applicability  to  specific  project  scenarios,  and  their  abilities  to  achieve  project  and 
organizational  goals.  The  specific  project  scenario  variables  represent  the  drivers  that 
determine  whether  outsourcing  strategies  are  successful.  Success  is  defined  in  terms  of 
organizational  and  project  goals.  The  factors  and  historical  experience  data  were 
combined  to  produce  a  framework  and  yielded  guidelines  or  rules.  The  rules,  in  turn, 
were  used  to  construct  a  decision  support  tool  to  aid  software  development  project 
managers  and  consultants  in  making  their  outsourcing  strategy  decisions  for  specific 
projects. 
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1.  Introduction 


Today's  business  environment  has  led  many  companies  to  streamline  business 
processes  and  outsource  activities  not  considered  “core”  business  functions.  In  many 
businesses,  software  development  is  classified  as  a  non-core  activity  (Vijayan  ).  In 
addition,  “The  software  industry  has  achieved  a  notorious  reputation  for  being  out  of 
control  in  terms  of  schedule  accuracy,  cost  accuracy,  and  quality  control”  (C.  Jones 
"Software  Project  Management  in  the  21st  Century" ).  In  response  to  these  problems  and 
business  trends,  software  developers  have  tried  process  improvement  techniques,  project 
management  techniques,  and  are  now  outsourcing  software  development  in  increasing 
numbers  (DiRomualdo  and  Gurbaxani ).  Like  their  counterparts  in  the  remainder  of  the 
business  world,  software  developers  think  an  outsourcing  vendor  can  do  the  job  cheaper, 
faster,  and  with  higher  quality  than  current  in-house  efforts.  Unfortunately,  nearly  thirty 
percent  of  outsourcing  relationships  end  in  dissatisfaction,  failure,  or  litigation  (C.  Jones 
"Conflict  and  Litigation  between  Software  Clients  and  Developers" ).  This  figure  is 
slightly  higher  than  the  24  percent  overall  industry  average  for  failed  projects  that  result 
in  termination  (C.  Jones  Patterns  of  Software  System  Failure  and  Success  ).  While  some 
authors  suggest  how  to  structure  an  outsourcing  contract  and  monitor  the  resulting  effort, 
none  offer  advice  on  how  to  select  appropriate  outsourcing  strategies  to  meet  specific 
project  goals. 

The  term  software  acquisition  has  long  been  used  to  describe  situations  where  a 
customer  contracts  with  a  software  development  organization  for  the  complete 
development  of  a  software  product  (possibly  including  life  cycle  maintenance). 
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Outsourcing  can  be  distinguished  from  acquisition  by  the  level  and  type  of  effort  agreed 
to  by  the  developer  and  customer.  Without  calling  their  business  arrangements 
"outsourcing,"  companies  have  long  outsourced  software  functions,  entire  software 
projects,  and  software  development  phases  (process  components).  The  following 
definition  encompasses  all  of  the  currently  recognizable  business  relationships  that 
constitute  software  outsourcing. 

Software  Outsourcing:  Contracting  (or  subcontracting)  with  an  external 

organization  for: 

•  the  development  of  complete  or  partial  software  products, 

•  the  purchase  of  packaged  or  customized  package  software  products,  or 

•  activities  to  aid  in  the  software  development  life  cycle. 

This  research  identified  outsourcing  strategies,  motivations,  benefits,  drawbacks, 
and  relevant  project  situation  variables  to  produce  a  taxonomy  structure.  This  structure 
will  encompass  the  factors  necessary  to  make  an  outsourcing  strategy  decision.  Industry 
experience  will  then  be  tapped  to  build  decision  heuristics  into  the  framework  and 
ultimately  produce  a  decision  support  tool  to  aid  software  development  project  managers 
and  consultants  in  making  their  outsourcing  strategy  decisions  for  specific  projects. 
There  are  six  specific  research  goals  shown  in  Table  1. 


1 .  Identify  the  different  types  of  software  outsourcing 

2.  Determine  motivations  for  software  outsourcing 

3.  Establish  the  benefits  and  drawbacks  of  each  type  of  outsourcing 

4.  Identify  the  project  scenario  variables  where  each  type  of  outsourcing 
is  likely  to  succeed  or  fail 

5.  Combine  the  outsourcing  experience  information  into  a  multi¬ 
dimensional  framework 

6.  Produce  a  decision  support  system  that  will  enable  users  to  select 
successful  outsourcing  strategies  for  their  project  situation  and  goals. 

Table  1:  Research  Goals 

Chapter  2  explains  the  concept  of  outsourcing  strategies  and  some  related 
outsourcing  literature.  Previous  work  is  shown  both  to  present  concepts  and  to  verify  it 
fails  to  meet  the  objectives  shown  above.  Chapter  3  identifies  the  research  methodology 
used  to  meet  the  goals  shown  in  Table  1 .  Chapter  4  outlines  the  results  of  survey  data 
analysis  and  development  of  rules-of-thumb  which  become  the  basis  for  a  decision 
support  tool  (discussed  in  Chapter  5).  The  final  important  task  of  validation  is 
extensively  described  in  Chapter  6.  Finally,  Chapter  7  reinforces  the  research 
contributions  and  identifies  future  work  that  can  build  upon  this  effort. 


2.  Background 


Section  2. 1  presents  definitions  of  software  outsourcing  types  and  strategies  and 
represents  a  new,  useful  model  for  understanding  software  outsourcing.  The  remainder 
of  this  chapter  outlines  related  software  outsourcing  literature.  In  anecdotal  fashion,  this 
literature  presents  some  useful  ideas  for  why  organizations  are  outsourcing  software 
development,  what  can  go  wrong  in  an  outsourcing  development,  and  how  to  manage  an 
outsourcing  relationship.  This  research  effort  built  upon  the  anecdotal  suggestions  by 
surveying  software  outsourcing  across  many  domains  to  broaden  the  understanding  of 
software  outsourcing  beyond  the  experiences  of  a  few  published  consultants. 

2. 1  Project-Level  Outsourcing  Strategies 
Figure  1  shows  a  high-level  view  of  the  software  outsourcing  domain.  Each  of 
these  categories  of  outsourcing  must  also  be  further  explained.  Figure  2  shows  the  two 
dimensions  of  an  outsourcing  strategy.  The  first  dimension,  percentage  of  in-house 
product  development,  indicates  the  portion  of  a  software  product  that  is  developed  in- 
house.  The  second  dimension,  percentage  of  development  process  phases  accomplished 
in-house,  defines  the  total  in-house  contribution  to  all  process  phases  of  software 
development.  For  example,  if  a  software  developer  outsourced  a  third  of  a  software 
product  and  also  outsourced  software  testing,  the  effort  could  be  placed  in  Figure  2  at 
approximately  point  A. 

In-house  efforts  [Figure  3]  are  those  efforts  where  the  entire  development  is 
accomplished  within  a  customer  organization.  This  type  of  software  project  forms  the 
border  of  the  outsourcing  definition.  All  but  this  rapidly  shrinking  category  of  projects 


5 


involve  some  amount  of  outsourcing.  Many  organizations  have  information  technology 
(IT),  prototyping,  applications,  or  otherwise-named  departments  responsible  for  in-house 
application  development.  Fewer  and  fewer  of  these  organizations  develop  products 
without  outsourcing  assistance  in  the  form  of  product  components,  process  assistance,  or 
outside  general  development  support. 
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Figure  1:  Software  Outsourcing  Domain 
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Figure  2:  Dimensions  of  Software  Outsourcing 
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The  first  type  of  outsourcing,  product  component  outsourcing,  is  perhaps  the 
simplest  outsourcing  arrangement  to  explain.  In  this  scenario,  a  developer  is  contracted 
to  provide  a  part  of  an  overall  system.  Figure  4  shows  an  example  of  a  total  system 
where  components  (e.g.,  fire  controls)  can  be  developed  separately  from  the  other  system 
components.  This  technique  includes  acquisition  of  re-usable  components, 
customization  of  common  applications,  complete  custom  component  development,  and 
many  hybrid  combinations  thereof. 


Airplane  Flight  Control  Software 

i - — 1 

Avionics  4 - 

— - *  Fire  Controls 

Backup  Flight  Controls 

4 - 

- *  Weapons  Control 

Primary  Flight  Controls 

4 - 

— *  Vehicle  Management  System 

Figure  4:  System  Component  Outsourcing 


Figure  5  shows  hypothetical  effort  levels  for  each  phase  of  a  product  component 
outsourcing  software  development  project.  In  its  simplest  incarnation,  product 
component  outsourcing  is  essentially  hiring  a  vendor  to  complete  a  horizontal  cross- 
section  of  the  overall  project  effort.  Since  all  systems  are  unique,  the  concept  of  varying 
effort  levels  across  development  stages  is  more  important  than  the  actual  levels  shown  in 


the  figure. 
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Figure  5:  Outsourcing  a  Product  Component 


In  the  next  scenario,  process  component  outsourcing,  the  customer  organization 
simply  contracts  for  an  external  group  to  perform  all  or  part  of  the  functions  of  one  or 
more  of  their  process  steps  or  components  [Figure  6].  Simply  put,  a  vendor  is  chosen  to 
perform  a  vertical  slice  of  the  project  effort.  One  traditional  example  is  contracting  for 
system-level  software  testing  shown  in  Figure  7  (Kaner ).  Notice  in  Figure  7  that  some 
portion  of  the  testing  effort  (e.g.,  integration  testing)  could  remain  in-house  along  with 
the  responsibility  to  manage  the  vendor  relationship. 


Figure  6:  Process  Component  (Development  Phase)  Outsourcing 
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Figure  7:  Outsourcing  a  Process  Component  (Testing  Component  Shown) 


Finally,  at  the  other  end  of  the  spectrum  from  in-house  efforts  are  traditional 
acquisitions,  shown  in  Figure  8  and  discussed  above.  The  U.S.  military  and  government 
agencies  lead  the  software  industry  in  both  procedures  and  understanding  of  software 
acquisition  efforts  (Joodi  and  Burklo  ).  Current  outsourcing  literature  focuses  on  this 
strategy  for  software  development  and  information  technology  service/infrastructure 
outsourcing.  Figure  8  shows  the  in-house  versus  contractor  effort  to  a  total  acquisition 
software  development  project.  Notice  that  some  level  of  in-house  effort  is  required  to 
oversee  contractor  software  development. 
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Figure  8:  Total  Acquisition 


2.2  Project  Planning  and  the  Outsourcing  Process 
Most  software  developers  begin  a  development  project  by  planning.  Among 
many  other  things,  a  development  plan  includes  project  organization  and  whether  and 
how  outsourcing  may  be  used  during  development.  The  outsourcing  strategy  is  the  type 
of  outsourcing  or  combination  of  outsourcing  types  used  on  a  project.  For  example, 
when  developing  flight  control  software  for  an  aircraft,  the  prime  developer  may  select  a 
strategy  of  outsourcing  both  the  system  level  software  testing  and  development  of  the 
avionics  software  subsystem. 


2.3  Outsourcing  Motivations 

Companies  turning  to  outsourcing  for  software  development  are  typically  under 
pressure  to  deliver  high-quality  products  -  within  budget  and  schedule  constraints. 
These  project  goals  as  well  as  organizational  policies  are  the  core  motivations  for 
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software  outsourcing.  Table  2  shows  a  published  list  of  outsourcing  motivations 
(Thomsett  "Outsourcing:  The  Great  Debate"  ). 

•  Reduced  costs  (economies  of  scale), 

•  Access  to  experience  and  skills, 

•  Reduced  development  duration, 

•  Risk  sharing, 

•  Elimination  of ‘non-core’  activities, 

•  Improved  control,  focus,  professionalism,  and 

•  Cash  flow  from  sale  of  intellectual  property. _ _ 

Table  2:  Outsourcing  Motivations 

All  but  the  last  three  of  these  motivations  are  self-explanatory.  Managers  wanting 
to  eliminate  ‘non-core’  activities  must  consider  which  capabilities  they  intend  to  be 
strategic  to  the  future  of  their  organization.  Thomsett  suggests  that  outsourcing  strategic 
capabilities  is  rarely  a  good  idea,  but  is  sometimes  necessary  for  surge  capacity 
(Thomsett  "Outsourcing:  The  Great  Debate" ).  Some  managers  believe  that  their  internal 
software  development  departments  are  out-of-control  and  that  a  contractual  relationship 
with  developers  will  actually  improve  their  visibility  into  development  and  focus  on 
software  development  costs  and  importance.  Other  organizations  want  to  divest  their 
current  software  property  and  desire  payment  from  an  outsourcing  organization  that  will 
take  over  the  rights  to  the  software.  In  this  case,  the  outsourcing  vendor  is  free  to  market 
the  software  outside  the  customer  organization.  Most  organizations  choose  to  outsource 
for  a  subset  of  these  documented  motivations. 

2.4  Outsourcing  Drawbacks 

While  organizations  enter  into  outsourcing  arrangements  with  high-expectations, 
published  research  in  the  literature  suggests  these  relationships  are  often  less  than 
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satisfactory  (C.  Jones  "Marry  in  Haste,  Repent  at  Leisure:  Successful  Outsourcing 
Requires  Careful  Consideration  and  Preparation"  ;  Demarco  and  Lister  ;  Yourdon ). 
According  to  Demarco  and  Lister,  29  percent  of  outsourcing  relationships  result  in  some 
dissatisfaction,  dissolution  of  the  relationship,  or  litigation  (Demarco  and  Lister ). 
Apparently  outsourcing  involves  trading  old  risks  for  new.  Table  3  lists  several  often- 
overlooked  drawbacks  to  outsourcing  (Thomsett  "Outsourcing:  The  Great  Debate" ). 

•  Increased  cost 

•  B-team  syndrome  (vendor’s  substitution  of  less  qualified 
personnel  for  those  originally  specified) 

•  Increased  risks 

•  Conflicting  agendas 

•  Reduced  control 

•  Loss  of  intellectual  capital 

•  Contractual  overhead 

•  Litigation _ _ _ 

Table  3:  Outsourcing  Drawbacks 

2.5  Best  Practices  for  Managing  an  Outsourcing  Relationship 
In  response  to  these  problems,  many  authors  have  proposed  guidelines  for 
selecting  vendors,  structuring  contracts,  and  managing  outsourcing  relationships.  Some 
of  these  ideas  are  presented  in  the  following  sections. 

2. 5. 1  Contractual  and  Legal  Issues 

Nai've  organizations  begin  outsourcing  with  unrealistic  expectations  of  simply 
deleting  some  in-house  effort  —  without  planning  for  the  overhead  required  to  establish 
and  to  monitor  the  contract.  While  software  engineers  are  typically  not  excited  about 
project  and  contract  management  details,  some  authors  suggest  that  a  solid  contract  and 
legal  advice  may  be  the  most  importation  actions  required  for  successful  outsourcing 
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(Thomsett  "Outsourcing:  The  Great  Debate" ;  Yourdon ).  According  to  Demarco  and 
Lister,  “it  is  not  unusual  for  a  large  software  development  organization  have  upwards  of 
50  active  cases  on  its  hands.  Litigation  costs  . . .  would  be  (when  spread  across 
unlitigated  as  well  as  litigated  projects)  a  larger  component  than  coding”  (Demarco  and 
Lister ). 

2.5.2  Vendor  Selection 

Once  an  organization  has  decided  to  outsource,  selecting  a  vendor  is  the  next 
important  task.  Table  4  shows  the  top  seven  factors  currently  considered  when  selecting 
a  software  outsourcing  vendor  (Yourdon,  Rubin  and  Mohnot ).  While  the  initial  decision 
to  outsource  is  frequently  made  to  reduce  costs,  Yourdon  concluded  that  it  is  just  the  fifth 
most  important  factor  in  picking  an  outsourcing  partner. 

•  Language  (Programming)  Familiarity 

•  Telecommunications  Connections 

•  Spoken  Language 

•  Large  Staff 

•  Price 

•  Rapid  Start 

•  Credentials _ _ 

Table  4:  Important  Outsourcing  Vendor  Selection  Factors 

2. 5.3  Planning  to  Avoid  Problems 

Since  disagreements  are  bound  to  arise,  several  authors  suggest  customers  spend 
more  time  ensuring  that  the  outsourcing  contract  properly  addresses  the  contractual 
aspects  of  software  estimation,  payment  strategies,  and  management  reviews.  While  not 
the  focus  of  this  research  effort,  we  found  that  structuring  the  agreement  also  impacts  the 
success  of  an  outsourcing  relationship.  This  section  is  included  to  explain  the  key 
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aspects  of  outsourcing  contracts  and  their  relationship  to  potential  decision  support  inputs 
shown  later. 

2.5.3. 1  Project  Estimation 

Capers  Jones  suggested  that  function  points  are  the  best  technique  for  estimating 
project  size  (C.  Jones  "Marry  in  Haste,  Repent  at  Leisure:  Successful  Outsourcing 
Requires  Careful  Consideration  and  Preparation" ).  He  also  explained  that  function 
points  and  proper  contract  wording  could  help  eliminate  conflicts  when  requirements 
creep.  Although  software  estimation  has  a  poor  track  record,  “projects  that  use  formal 
estimating  tools  . . .  have  much  better  track  records  of  staying  within  budgets  and  actually 
finishing  without  serious  mishaps”  (C.  Jones  "Marry  in  Haste,  Repent  at  Leisure: 
Successful  Outsourcing  Requires  Careful  Consideration  and  Preparation"  ).  Jones  noted 
that  outsourcing  has  produced  new  requirements  for  higher-level  estimation  shown  in 
Table  5. 


•  Portfolio  growth,  maintenance,  and  retirement 

•  Latent  defects  and  the  impact  of  quality  control 

•  Staffing  by  occupation  group 

•  Head-count  of  staffing  by  time  period 

•  Effort  by  time  period 

•  Costs  by  occupation  group  and  time  period 

•  Special  factors  such  as  mass  Year  2000  upgrades 

•  Inflation  rates 

Table  5:  High-Level  Software  Estimation  Requirements 

Jones  also  suggested  that  these  estimation  features  could  help  curb  the  increasing 
percentage  of  software  litigations,  dissatisfaction,  and  contract  re-negotiations  (C.  Jones 
"Software  Project  Management  in  the  21st  Century" ). 
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2. 5. 3. 2  Payment  Strategies 

In  addition  to  estimating  the  effort  properly,  contracts  should  delineate  payment 
schedules,  costs,  and  profit  sharing.  Preferably,  parties  should  agree  to  an  equitable 
arrangement  where  the  developers  are  paid  for  functionality  rather  than  code  volume  thus 
reducing  the  urge  to  add  unnecessary  functions  and  requirements.  The  metrics  used  to 
track  progress  for  quality  and  payment  should  also  be  defined.  Customers  should  provide 
for  insight  into  the  outsourced  development  effort  to  help  manage  overall  effort. 

2. 5. 3. 3  Project  Personnel  Experience 

One  common  complaint  about  software  acquisition  is  that  developers  bid  a  more 
highly  experienced  team  than  actually  used  once  the  contract  is  awarded.  Sound 
contracts  include  information  about  required  experience  and  skill  levels  to  help  ensure  the 
actual  team  quality  matches  the  proposed  team  quality. 

2. 5. 3. 4  Reviews  and  Oversight 

Both  parties  should  also  agree  to  joint  project  management  and  technical  reviews 
that  include  risk  management  to  incentivize  early/frequent  identification  and  resolution  of 
project  risks.  The  Software  Program  Manager’s  Network  suggests  that  low  level  “inch- 
pebbles”  (rather  than  high-level  milestones)  must  be  established  to  identify  clear 
transitions  from  one  project  phase  to  another.  Customer  involvement  in  reviews  and  the 
decision  authority  for  these  transitions  must  be  spelled  out  in  the  contract  (SPMN  ). 
Finally,  Thomsett  suggests  that  ownership  of  legacy  code  and  developed  components 
should  also  be  clearly  defined  (Thomsett  "Outsourcing:  The  Great  Debate" ).  While 
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items  in  Table  2  motivate  customers,  developers  may  be  motivated  to  develop  a  product 
they  hope  to  re-use  throughout  the  market. 

2.5.4  Communication  Issues 

The  most  widely  discussed  software  outsourcing  strategy  is  to  acquire  an  entire 
software  product  from  a  company  outside  their  home  country.  “Offshore  Outsourcing” 
has  schedule  and  price  improvement  potential,  but  presents  other  unique  challenges. 
Offshore  outsourcing  efforts  appear  to  magnify  challenges  experienced  by  in-country 
outsourcing  arrangements.  In  addition  to  varied  corporate  cultures,  international 
outsourcing  challenges  both  parties  with  language  barriers,  cultural  misunderstandings, 
and  communications  infrastructure  shortfalls  as  explained  in  the  following  sections. 

Obviously,  arranging  delivery  of  products,  scheduling  meetings,  and  answering 
questions  become  more  difficult  when  locations  are  on  opposite  sides  of  the  earth.  If 
some  overlap  exists,  however,  the  time  difference  can  be  used  to  create  a  longer  ‘virtual’ 
workday  (Watanabe ). 

As  shown  in  Table  4,  sharing  a  common  language  is  the  third  most  important 
factor  in  selecting  an  outsourcing  partner.  Obviously  the  ability  to  explain  and 
understand  requirements  is  crucial  to  producing  a  suitable  and  effective  system.  In 
addition  to  language,  some  cultures  encourage  far  less  questioning  and  sharing  of 
opinions  from  employees  than  can  be  expected  of  employees  in  U.S.  companies.  As  a 
result,  U.S.  customers  must  work  to  extract  questions,  risks,  and  opinions  from  Indian 
offshore  developers.  Well-understood  cultural  interactions  will  help  improve  project 


communication. 
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In  addition  to  distances  and  language  differences,  deciding  how  and  when  to 
communicate  often  requires  offshore  developers  improve  their  communication 
infrastructure  and  connectivity  to  the  customer  organization.  While  most  U.S.  developers 
have  excellent  Internet  and  e-mail  access,  many  foreign  countries  lag  somewhat  behind. 
Time  zone,  location,  and  language  differences  strengthen  the  need  for  groupware  tools 
that  enable  communication  between  offshore  vendors  and  their  customers.  Video 
teleconferencing,  file  transfer,  e-mail,  web  tools  (dashboards,  chat  windows,  discussion 
boards,  and  whiteboards),  and  telephone  communications  are  typically  part  of  a  shared 
suite  of  tools  required  to  meet  offshore  outsourcing  communication  needs  (Coleman  ; 
Nunamaker  et  al. ;  Sproull  and  Kiesler  ;  Ackermann  and  Starr  ). 

2. 5. 5  People  Issues 

Outsourcing  is  often  a  controversial  issue  for  customer  organizations.  When 
entire  projects  are  outsourced,  in-house  jobs  are  often  transferred  or  eliminated.  In 
addition,  outsource  developers  are  not  normally  as  well  versed  in  domain  expertise  as  in- 
house  developers.  If  requirements  are  not  communicated  clearly,  resulting  systems  may 
not  meet  user  expectations. 

2.6  Outsourcing  Metrics 

Outsourcing  metrics  can  be  categorized  into  nine  classes  as  shown  in  Figure  9 
(Yourdon,  Rubin  and  Mohnot ).  These  classes  match  those  required  for  thorough 
tracking  of  any  in-house  effort.  The  only  major  difference  appears  to  be  that  outsourcing 
metrics  collection,  definition,  and  visibility  must  be  explicitly  defined  in  the  development 
contract.  Surveys  during  this  research  attempted  to  capture  relevant  project  variables  and 
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outsourcing  strategies  for  correlation  with  goal  satisfaction.  Some  outsourcing  metrics 
questions  were  also  asked  to  assist  other  research  on  modeling  the  outsourcing 
development  and  study  the  relationship  between  vendor  tracking  and  goal  satisfaction. 

•  Finance  and  budget 

•  Customer  satisfaction 

•  Work  product  delivery 

•  Quality 

•  Time  and  schedule 

•  Business  value 

•  Operational  service  levels 

•  Human  resources 

•  Productivity _ 

Figure  9:  Outsourcing  Metrics  Classes 

2.7  Contrast  between  Software  Outsourcing  and  IT  Outsourcing 
Outsourcing  is  in  vogue  for  a  wide  range  of  businesses  from  farming  to  chemicals 
to  information  technology  to  software  development  (Kaner ;  Anthes  ;  Brandel ;  Wee  ; 
Donahue  ;  Cole-Gomolski ;  Opperthauser  ;  Gallivan  ;  Klenke  ;  Lacity,  Willcocks  and 
Feeney  ;  Kiechel ;  McFarlan  and  Nolan  ;  Lacity  and  Hirschleim  ;  King  ;  Hoffman  ; 

Nadile ).  In  1998  information  technology  outsourcing  exceeded  $99  billion  and  is 
expected  to  reach  more  than  $151  billion  by  2003  (TJ.S.  And  Worldwide  Outsourcing 
Markets  and  Trends  1998-2003  ).  Software  development  outsourcing,  however,  differs 
from  most  outsourcing  because  companies  are  attempting  to  contract  complex, 
intellectual  ‘project’  work  rather  than  typical  repetitious,  well  understood  ‘process  work’ 
(Thomsett  "Outsourcing:  The  Great  Debate" ).  For  example,  many  companies  have 
outsourced  hardware  computer  support.  Hardware  computer  support  certainly  requires 
intelligence  and  experience,  but  it  is  largely  repetitious  and  somewhat  simpler  than 
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developing  software  products  from  high-level  user  requirements.  As  a  result,  the  vast 
collection  of  IT  outsourcing  experience  literature  is  of  limited  value  to  a  customer  trying 
to  select  an  outsourcing  strategy  to  meet  an  organization’s  software  development  goals 
(Thomsett  "Software  Development  Outsourcing" ).  While  some  outsourced  software 
effort  may  be  considered  process  work  (e.g.  test  execution  or  library  version  control 
work),  the  project-type  work  will  be  the  main  focus  of  this  research  effort. 

2.8  Conflicting  Goals 

Like  in-house  software  developments,  software  projects  that  involve  outsourcing 
require  balancing  the  often-conflicting  goals  of  low  cost,  high  quality/reliability,  and 
speedy  development.  As  noted  above,  these  goals  represent  a  subset  of  outsourcing 
motivations.  For  most  domains,  cost  overruns  and  schedule  slippages  are  commonplace 
(Putnam  and  Myers ). 

In  addition  to  project  goals,  different  goals  for  developers  versus  customers  are 
magnified  under  a  contractual  relationship.  While  in-house  developers  and  users  share 
some  common  upper  management,  the  same  is  not  true  for  outsourcing  relationships. 

2.9  Need  for  Research 

While  many  published  ideas  for  managing  software  outsourcing  projects  appeal  to 
practitioners,  it  is  not  clear  whether  these  guidelines  are  applicable  to  all  project  domains 
and  outsourcing  strategies.  Researchers  have  also  not  shown  how  types  of  outsourcing 
strategies  affect  project  consequences.  For  these  reasons,  this  research  effort  was 
undertaken  to  fill  the  voids  in  our  understanding  of  software  outsourcing. 
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This  research  effort  matched  successful  outsourcing  strategies  with  project 
constraints  and  goals  rather  than  outline  steps  to  make  any  outsourcing  relationship 
satisfactory.  The  latter  topic  has  been  well  covered  in  recent  literature  as  outlined  in 
earlier  in  this  chapter.  The  overall  research  picture  can  be  seen  in  Figure  10.  The  core 
effort  of  this  research  is  focused  on  determining  how  product  level  outsourcing  strategies 
and  domain  factors  impact  outsourcing  consequences.  In  addition,  customer  and  supplier 
characteristics,  relationship  management  policies,  and  project  and  product  characteristics 
will  be  studied  to  measure  their  interplay  with  outsourcing  strategies  and  consequences. 
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Figure  10:  A  Hypothetical  Model  of  Software  Outsourcing 


3.  Research  Methodology 


Given  the  lack  of  clear  guidelines  on  outsourcing,  a  three-phased  research  effort 
was  undertaken  to  clarify  outsourcing  strategy  types,  motivations,  success  and  failure 
experiences,  and  to  produce  a  decision  support  tool  for  selecting  appropriate  outsourcing 
strategies.  This  chapter  outlines  the  research  effort  tasks  and  their  relationships  with 
specific  research  goals.  Section  3.1  summarizes  the  industry  survey  design,  followed  by 
specific  data  analyses  in  Section  3.2,  and  ultimately  the  resulting  decision  support  tool 
and  validation  effort  as  discussed  in  Section  3.3. 

3 . 1  Phase  One  -  Industry  Survey 

The  first  task  after  the  initial  literature  review  was  to  develop  a  survey 
questionnaire  and  locate  potential  respondents.  Special  care  was  taken  to  minimize  the 
amount  of  required  respondent  writing  and  limit  the  response  scales  to  appropriate  levels 
of  significance  and  comprehension.  The  questionnaire  employed  Likert  response  scales 
and  limited  granularity  to  seven  levels  of  differentiation  per  psychological  research 
(Miller ).  The  entire  survey  instrument  is  included  as  Appendix  C.  Once  completed,  the 
survey  was  pre-tested  on  Arizona  State  University  Computer  Science  and  Engineering 
Department  graduate  students  to  refine  the  instrument  and  identify  additional  outsourcing 
contacts.  These  pre-test  responses  were  not  included  in  the  final  data  anlysis. 

Industry  software  project  personnel  were  asked  to  characterize  their  outsourcing 
experiences  based  on  strategy,  project  scenarios,  goals,  and  project  success.  Specifically, 
the  survey  asked  respondents  to  identify  project  scenarios  where  each  outsourcing 
strategy  is  likely  to  succeed  or  fail.  In  addition  to  strategies,  the  project  variables  were 
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collected  via  survey  to  determine  their  impact  on  success  or  failure  of  an  outsourcing 
project.  The  survey  results  were  statistically  correlated  with  goal  success  and  failure  to 
create  dependable  heuristic  rules  and  answer  the  research  goals  identified  in  Chapter  1 
and  discussed  below. 

3. 1. 1  Determine  the  different  types  of  software  outsourcing 

The  literature  provides  examples  of  a  few  outsourcing  strategy  types  such  as 
offshore  coding,  reengineering,  and  total  acquisition  (Watanabe  ;  Thomsett  "Outsourcing: 
The  Great  Debate" ;  Yourdon  ).  This  research  effort  included  a  broad  survey  to 
determine  as  many  in-use  strategies  as  possible  was  the  first  step  to  creating  a  framework. 
The  survey  results  identified  many  undocumented,  in-use  strategies  filling  part  of  the 
continuum  proposed  in  the  proposed  definition  of  outsourcing. 

3.1.2  Determine  motivations  for  software  outsourcing 

While  not  necessarily  generalizable  to  the  global  software  industry,  survey 

respondents  identified  many  motivations  for  software  outsourcing  that  extend  beyond 
those  commonly  published.  These  motivations  also  serve  as  organizational  goals  -  which 
are  required  to  determine  whether  a  particular  outsourcing  strategy  is  successful. 

3.1.3  Establish  the  benefits  and  drawbacks  of  each  type  of  outsourcing 

The  correlation  of  goals  (motivations),  their  success  or  failure,  and  particular 
outsourcing  strategies  resulted  in  expert  information  or  rules  that  helps  clarify  when 
strategies  are  appropriate.  These  rules  will  become  the  basis  for  an  expert  system. 
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3.2  Phase  Two  -  Survey  Analysis  and  Framework  Construction 
The  purpose  of  phase  two  was  to  combine  the  outsourcing  experience  information 
and  the  taxonomy  structure  information  to  complete  and  refine  the  proposed  multi¬ 
dimensional  framework. 

3.2. 1  Survey  Demographics  and  Outsourcing  Levels 

The  first  and  simplest  analyses  were  straightforward  histograms  and  summary 
information  detailing  the  current  levels  of  outsourcing,  amount  of  experience  for  each 
respondent,  respondents’  outsourcing  roles,  and  software  domains  included  in  the  survey. 
All  non-blank  responses  were  used  in  the  analysis. 

3.2.2  Decision  Maker  Roles 

Responses  to  Question  1 1  from  the  survey  were  analyzed  graphically  using 
histograms  to  determine  which  positions  or  roles  have  the  greatest  impact  on  the  success 
or  failure  of  an  outsourcing  project. 

3.2.3  Outsourcing  Goals 

Statistical  analysis  of  the  respondents’  outsourcing  goals  indicated  both  the  level 
of  importance  and  satisfaction  for  each  goal  in  Question  nine  from  the  survey. 

3.2.4  Analysis  of  software  outsourcing  strategies 

A  software  outsourcing  strategy  is  the  combination  of  product  and  process 

components  outsourced  for  a  particular  project.  The  researcher  found  many  strategy 
factors  to  be  strongly  related  to  the  outsourcing  consequences  listed  in  Question  10  of  the 


survey  instrument. 
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3.2.4. 1  Product  Components  Outsourced 

Products  were  categorized  as  either  custom,  common  off-the-shelf  applications,  or 
customized  versions  of  common  applications.  These  distinctions  are  important  because 
they  identify  pure  custom  work,  pure  supplier  work,  and  hybrid  software  development 
requirements. 

3.2. 4. 2  Process  Components  Outsourced 

While  the  many  types  of  product  components  are  a  vast  set,  process  components 
are  fairly  well  understood  from  the  software  engineering  literature.  Question  seven  from 
the  survey  delineates  the  processes  and  respondents  indicated  whether  they  have 
outsourced  each  individual  process.  The  processes  were  later  subdivided  into  core 
processes,  necessary  for  the  transformation  of  requirements  to  functional  software,  and 
support  processes  that  when  outsourced  reduce  in-house  workload.  Analysis  consisted  of 
histograms  to  determine  which  processes  and  combinations  of  processes  are  frequently 
outsourced.  The  combinations  of  processes  will  also  be  reviewed  to  determine  if  they 
constitute  process-only  outsourcing,  product-only  outsourcing,  or  a  hybrid  approach.  All 
of  these  factors  were  later  used  as  independent  variables  in  the  statistical  analysis  to  find 
outsourcing  rules  for  the  decision  support  tool. 

3. 2. 5  Capturing  Framework  Rules 

Two  techniques  were  proposed  and  attemped  to  capture  the  framework  rules  from 
the  survey  data.  First,  tools  were  used  to  train  neural  networks  to  predict  outsourcing 
consequences  based  on  the  independent  scenario  variables.  Two  problems  were  found 
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with  this  technique.  First,  defining  the  proper  topology  for  neural  networks  is  not  well- 
defined  (Russell  and  Norvvig ).  While  some  high-level  guidelines  concerning  the 
number  of  neural  network  layers  are  understood,  extensive  data  is  required  for  the  cross- 
validation  necessary  to  demonstrate  that  a  proper  network  topology  has  been  selected. 

Because  of  these  uncertainties  and  the  amount  of  data  required,  the  second  technique  was 
selected. 

The  statistical  regression  runs  to  determine  which  project  strategy  variables 
describe  the  consequence  of  software  outsourcing  projects  were  the  most  important  parts 
of  the  analysis.  All  process  components,  product  component  types,  software  domains, 
and  strategy  factors  were  considered  as  possible  independent  variables  in  a  step-wise 
linear  regression  for  each  outsourcing  consequence.  The  step-wise  technique  was 
selected  since  it  ensures  that  variables  selected  for  the  model  met  the  standard  95  percent 
confidence  level  criteria.  Alternative  models  were  produced  using  forward,  backward, 
and  removal  techniques,  but  all  had  the  same  failing.  In  the  alternative  regression  models 
performed  well  and  explained  most  of  the  variance  for  each  consequence  but  included 
many  statistically  insignificant  inputs.  This  downfall  would  have  given  a  false  sense  of 
security  to  decision  support  tool  users. 

3.2.6  Distill  Qualitative  Outsourcing  Assertions 

The  means  of  outsourcing  assertions  were  statistically  compared  to  values  from 
the  response  scale  to  yield  the  suggestions  that  form  the  second  half  of  the  decision 
support  tool.  Many  of  these  assertions  (found  in  the  survey  instrument  show  in  Appendix 
C)  came  from  published  outsourcing  literature. 
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3.3  Phase  Three  -  Decision  Support  Tool  Construction  and  Validation 
Once  the  outsourcing  rules  and  assertions  were  produced,  they  were  included  in  a 
decision  support  tool.  This  tool,  meant  as  a  prototype,  contains  the  knowledge  captured 
from  survey  data  and  is  suitable  for  use  as  a  means  of  better  understanding  how 
outsourcing  strategies  and  scenarios  affect  the  outcomes  or  consequences  of  a  software 
outsourcing  project. 


3.4  Methodology  Summary 

This  chapter  explained  how  the  research  effort  was  organized  to  meet  the  research 
goals  identified  in  Chapter  one  and  shown  to  be  lacking  in  current  literature  in  Chapter 
two.  Chapter  four  will  detail  the  implementation  of  this  methodology  specifically 
focusing  on  the  survey  results  and  analyses  that  form  the  basis  for  the  outsourcing 
strategy  framework  and  decision  support  tool. 


4.  Survey  Results 

The  initial  survey  was  originally  conceived  to  establish  a  “state  of  the  practice” 
for  software  development  outsourcing.  This  type  of  data  is  not  available  in  the 
‘anecdotal’  software  outsourcing  literature  (Dedene  and  DeVreese  ;  C.  Jones  "Marry  in 
Haste,  Repent  at  Leisure:  Successful  Outsourcing  Requires  Careful  Consideration  and 
Preparation"  ;  C.  Jones  "Conflict  and  Litigation  between  Software  Clients  and 
Developers" ;  Kaner ;  Opperthauser ;  Thomsett  "Outsourcing:  The  Great  Debate" ; 
Thomsett  "Software  Development  Outsourcing" ;  Yourdon,  Rubin  and  Mohnot ; 

Yourdon ).  The  survey  scope  was  eventually  expanded  to  include  specific  project-related 
outsourcing  data.  In  addition  to  establishing  the  state  of  software  development 
outsourcing,  this  analysis  was  intended  to  produce  the  basic  rules  for  guiding  software 
developers’  outsourcing  strategies. 

This  chapter  begins  with  a  discussion  of  survey  sampling  and  extensibility. 
Section  4.3  provides  a  high-level  analysis  which  establishes  the  current  levels  and  types 
of  outsourcing  and  their  results.  Section  4.4  through  4.7  continue  this  surface-level 
analysis  describing  decision  maker  roles  and  detailed  analysis  of  current  outsourcing 
strategies.  Sections  4.8  and  4.9  present  a  correlation  analysis  that  provides  specific 
outsourcing  “rules  of  thumb”  from  the  survey  data. 

4.1  Responses  and  Sampling 

This  survey  was  distributed  worldwide  to  the  individuals,  groups,  and 
organizations  shown  in  Table  6.  A  total  of  87  responses  were  received  and  included  in 
the  analysis.  A  total  of  320  paper  surveys  were  sent  to  Arizona-based  software 
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developers.  24  negative  replies  were  received  including  several  organizations  that  stated 
they  had  tried  outsourcing  and  would  never  use  it  again.  Negative  replies  were  not 
included  in  the  results. 


Group  or  Organization 

Distribution  Method 

All  active  and  ‘emerging’  software  process 
improvement  network  (SPIN)  groups  in  the 
world 

E-Mail 

Phoenix  SPIN 

Research  proposal  presentation  and  direct 
hand-out  of  surveys 

Arizona-based  software  developers 

Standard  Mail  (Initial  and  Follow-up) 

Board  members  of  the  Arizona  Software 
Association  (now  called  the  Arizona 
Software  and  Internet  Association  or 
AZSOFT.net) 

Both  Standard  and  Electronic  Mail 

DoD  Software  Developers 

Notice  in  Crosstalk  -  The  Defense  Journal 
of  Software  Engineering 

ACM  Special  Interest  Group  on  Software 
Engineering  (SIGSOFT) 

Notice  in  Software  Engineering  Notes 

Selected  Industry  Contacts 

E-Mail 

Software  Engineering  Newsgroup 
(comp .  software-eng) 

Electronic  Posting 

Table  6:  Survey  Respondents  and  Methods  of  Contact 


Sampling  for  this  survey  was  not  traditional  random  sampling  from  a  known 
population.  Within  the  state  of  Arizona,  every  known  software  development  organization 
was  sent  a  survey  packet.  A  follow-up  packet  was  resent  to  organizations  that  did  not 
respond  to  the  initial  mailing.  Each  SPIN  group,  personal  industry  contacts,  and  software 
engineering  newsgroup  readers  were  invited  to  take  the  survey  via  e-mail,  web-based 
survey,  or  the  paper-based  questionnaire. 


4.2  Extensibility 

Several  extensibility  concerns  exist  for  these  results.  Because  the  sample  size 
(87)  is  significantly  smaller  than  the  approximate  population  size  of  the  software 
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industry,  the  sample  can  be  considered  random  (Devore ).  Unfortunately,  this 
assumption  of  randomness  overlooks  the  fact  that  50  percent  of  the  responses  come  from 
the  state  of  Arizona  alone.  While  this  does  not  invalidate  the  research,  one  must  be 
careful  to  remember  the  results  may  be  based  upon  market  influences  that  may  differ 
elsewhere.  To  an  extent,  this  problem  is  balanced  by  the  remaining  survey  responses 
coming  from  other  parts  of  the  United  States  and  international  software  organizations. 
Nevertheless,  the  focus  was  primarily  on  United  States  organizations. 


4.3  Demographics 


4.3.1  Outsourcing  Experience 

The  respondents  as  a  group  averaged  just  over  five  outsourcing  project 
experiences  with  the  vast  majority  of  respondents  in  the  zero  to  five  range  and  remainder 
making  up  the  more  experienced  “tail”  on  the  right  side  of  the  distribution  curve  (Table  7 
and  Figure  11). 


Number  of 
Projects  per 
Respondent 

Percent  of 
Outsourcing 
within 
Respondent 
Organization 

Mean 

5.5132 

26.6753 

Median 

3.0000 

10.0000 

Mode 

2.00 

.00 

Std.  Deviation 

7.0569 

31.6712 

Table  7:  Experience  and  Company  Outsourcing  Levels 


Frequenc 
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Number  of  Outsourcing  Projects 

Figure  11:  Respondent  Experience 

4.3.2  Respondent  Outsourcing  Roles 

Many  respondents  indicated  fulfilling  several  roles  during  outsourced  software 
development  projects.  While  the  survey  was  sent  directly  to  corporate  software 
development  managers,  the  most  frequently  noted  respondent  role  was  contract  officer 
for  the  customer  organization.  The  distribution  of  roles  in  Figure  12  indicates  a  good  mix 
of  customer  and  vendor  responses.  Sixty-seven  of  the  respondents  identified  themselves 
as  part  of  the  customer  organization  while  fifteen  identified  themselves  as  members  of 


vendor  organizations. 
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Respondent  Roles 


Figure  12:  Respondent  Outsourcing  Roles 


4.3.3  Company  Outsourcing  Levels 

Table  7  shows  the  levels  of  software  outsourcing  in  the  respondents’ 
organizations.  This  distribution  is  also  pictured  in  Figure  13.  Most  respondents’ 
organizations  outsource  approximately  ten  percent  of  their  software  development  effort. 
Several  organizations  outsource  more  than  fifty  percent  of  their  development  effort, 
raising  the  mean  to  more  than  twenty-five  percent. 
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Figure  13:  Levels  of  Outsourcing 


4.3.4  Domain  Coverage 

The  organizations  represented  by  the  87  survey  respondents  included  all  of  the 
four  major  software  domains  shown  in  Table  8.  These  categories  were  gleaned  from 
several  sources  including  Capers  Jones’  text  on  programmer  productivity  (C.  Jones 
Programming  Productivity  ).  While  most  companies  identified  working  in  several  sub¬ 
categories  within  their  domain,  the  majority  were  associated  with  a  single  major  domain 
(Figure  14).  The  fact  that  some  organizations  work  in  multiple  domains  explains  why  the 
numbers  in  columns  two  and  three  of  Table  8  do  not  sum  to  87  and  100  percent 
respectively. 
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Systems  Software 

Enterprise  Software  Development 

Shrink  Wrap  (Commercial/Consumer  Software) 

Software  Component  Development 


N 

Percent 

49 

56% 

45 

52% 

32 

37% 

31 

36% 

Table  8:  Software  Domains  Represented  in  the  Initial  Survey 


Figure  14:  Major  Domains  within  Each  Organization 

4.4  Decision  Maker  Roles 

Figure  15  shows  the  roles  that  most  strongly  influence  outsourcing  decisions  on 
software  development  projects.  As  expected,  project  manager  and  technical  lead  roles 
typically  craft  outsourcing  arrangements.  Frequently  respondents  included  corporate 
policies  and  decisions  as  the  driving  force  in  outsourcing  decisions.  This  underscores  the 
strategic  nature  of  many  outsourcing  decisions.  Respondents  clearly  identified  vendor 


project  managers  as  the  only  strong  influence  from  the  vendor  side  of  the  outsourcing 
relationship  (Figure  16). 
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Project  Manager  Corporate  Technical  Lead  Corporate  Software  Contract  Officer  Other  Management 
Management  Management  Developer  Consultant 

Decision  Policy 

Customer  Decision  Maker  Role 


Figure  15:  Outsourcing  Decision-Maker  Roles  in  the  Customer  Organization 
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Figure  16:  Outsourcing  Decision-Maker  Roles  in  the  Vendor  Organization 

The  key  outsourcing  decision  makers  for  each  project  are  indicated  in  Figure  17. 
As  expected,  customer  program  managers  lead  the  ranks  of  decision  makers,  but  the 
vendor  program  managers  also  appear  to  have  a  significant  hand  in  determining  the 
outsourcing  relationship. 
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Outsourcing  Decision  Makers 


D  Series  1 


Figure  17:  Outsourcing  Decision  Making  Roles 

4.5  Product  Component  Types  Outsourced 
Outsourced  products  where  characterized  as  either  customized  common 


applications,  common  applications  (COTS),  or  completely  custom  work.  Figure  1 8 
shows  general  categories  of  outsourced  software  products  identified  in  the  survey. 
Clearly  custom  development  represents  the  majority  of  respondents’  outsourced  software 
products.  The  prevalence  of  outsourcing  custom  software  development  indicates  that 
developers  look  to  vendors  with  domain  experience  and  products  that  can  be  tailored  for 
a  project’s  needs. 
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Common  Application  (Customized)  Common  Application  (COTS)  Custom  (Specialized) 


Figure  18:  Types  of  Outsourced  Software  Products 

4.6  Process  Components  Outsourced 
Whether  outsourcing  product  components  or  processes,  respondents  indicated 
which  processes  the  outsourcing  vendors  performed  or  supported.  Figure  19  shows  the 
percentage  of  respondents  who  indicated  their  organization  outsourced  particular 
processes  components. 


Figure  19:  Relative  Frequency  of  Outsourced  Software  Development  Processes 


4.7  Outsourcing  Strategies 

One  of  the  key  objectives  of  this  research  was  to  determine  how  software 
developers  organize  for  outsourcing.  This  information  begins  with  the  responses  to  the 
initial  survey’s  questions  about  which  development  processes  were  outsourced.  The 
individual  processes  listed  were  later  subdivided  into  ‘core’  and  ‘support’  processes.  A 
company’s  strategy  is  considered  product  outsourcing  if  the  organization  outsources  at 
least  design  and  coding  from  the  set  of  core  processes  (requirements,  specification, 
design,  coding,  testing,  and  maintenance).  This  definition  of  product  outsourcing  is 
defensible  since  product  outsourcing  typically  involves  transforming  a  customer’s 
requirements  into  a  product  component.  Design  and  coding  actually  accomplish  that 
transformation  leaving  integration  and  testing  responsibilities  as  a  separate  strategy 
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decision.  Outsourcing  that  does  not  meet  the  product  outsourcing  requirement  is 
considered  process  outsourcing. 

As  expected,  most  outsourcing  strategies  involved  some  product  component 
outsourcing  (Table  10).  The  amount  of  process  outsourcing  from  this  survey  was 
surprising  because  process  outsourcing  is  not  discussed  in  typical  software  outsourcing 
literature.  In  fact,  many  software  outsourcing  articles  begin  by  discussing  the  unique 
project-related  aspects  of  software  and  information  technology  outsourcing  and  how  they 
differ  from  generic  outsourcing  (Rubin  ;  Thomsett  "Outsourcing:  The  Great  Debate" ). 
Only  a  few  discuss  offshore  reengineering  efforts  or  contract  maintenance  (Rubin  ; 
Watanabe ).  Neither  of  these  processes  truly  qualifies  as  discussions  of  process 
outsourcing.  Thus  realizing  that  fully  30  percent  of  all  respondent’s  outsourcing  projects 
involved  outsourcing  only  processes  to  a  vendor  appeared  incongruous  with  software 
outsourcing  literature.  More  than  50  percent  of  respondents’  outsourcing  projects 
consisted  of  a  hybrid  process  and  product  component  outsourcing  strategy.  Most 
respondents  indicated  that  their  organization  outsourced  between  two  and  four  core 
processes  and  two  or  fewer  support  processes  (Table  9,  Figure  20,  and  Figure  21).  Thus 
the  average  outsourcing  project  included  hiring  vendors  to  perform  between  four  and  five 
process  components  in  the  software  development  process. 


CORE 

SUPPORT 

Mean 

3.2308 

1.5641 

Median 

3 

1 

Table  9:  Number  of  Processes  Outsourced 


Frequency 
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Std.  Dev  =  1.71 
Mean  =  3.2 
N  =  78.00 


Figure  20:  Number  of  Core  Processes  Outsourced 


Std.  Dev  =  1.97 
Mean  =  1.6 
N  =  78.00 


Figure  21:  Number  of  Support  Processes  Outsourced 
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Total 

Percent 

Product 

61 

70.1% 

Process 

71 

81.6% 

Process  Only 

26 

30% 

Product  Only 

16 

18% 

Both 

45 

52% 

Table  10:  Process  versus  Product  Outsourcing  Strategies 


4.8  Outsourcing  Project  Goals 

4.8.1  Analysis  Techniques 

Statistical  techniques  were  used  to  determine  what  goals  respondents’  considered 
important.  The  first  technique  is  the  T-test.  This  test  compares  the  sample  means  to  a 
constant.  In  this  case,  goal  importance  was  defined  on  a  five-point  scale  from  “not 
important”  (one)  to  “very  important  (two).  The  scale  can  be  found  in  question  nine  of  the 
survey  questionnaire.  A  goal  has  some  level  of  importance  if  the  sample  mean  is 
statistically  different  (higher)  than  the  value  for  “not  important”  (one).  While  a  simple 
comparison  of  means  gives  some  indication  of  the  importance,  the  T-test  allows  a 
researcher  to  make  statistical  claims.  Similarly,  the  sample  mean  for  each  goal  can  be 
compared  to  other  values  on  the  response  scale  to  determine  if  they  are  considered 
“somewhat  important”,  “very  important”,  or  some  other  value. 

A  significant  difference  between  the  observed  mean  and  the  neutral  answer 
implies  that  the  factor  comes  from  a  different  population  than  the  neutral  answer.  The 
sample  size  and  mean-difference  also  combine  to  produce  significance  values  that 
indicate  how  confident  the  researcher  can  be  about  the  level  of  difference.  To  complete 
the  analysis,  the  Bonferroni  correction  was  used  to  calculate  the  actual  levels  of 
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significance  and  confidence  intervals.  The  Bonferroni  correction  eliminates  the 
possibility  of  finding  significant  differences  between  several  sample  variables  by  chance 
alone  (SPSS  Inc. ).  In  this  technique,  the  alpha  level  is  divided  by  the  number  of 
variables  included  in  a  one-sample  T-test.  For  example,  if  a  99  percent  confidence  level 
is  necessary  when  conducting  one-sample  T-test  on  22  variables,  a  researcher  would 
adjust  the  significance  as  follows: 

a  =  .01 

Bonferroni  corrected  ahr  = a/  ,  n  •  , ,  = 

bt  /number  of  variables  /22 

Bonferroni  Corrected  Significance  =  1  -abc  =  0.999545 
Thus  simultaneous  one-sample  T-tests  on  22  variables  can  achieve  a  99  percent 
confidence  level  when  the  analyses  are  conducted  using  the  tighter  99.9545  percent 
bonferroni  confidence  level. 

Similar  analysis  will  be  used  to  determine  the  degree  to  which  these  goals  were 
realized  for  respondents’  outsourcing  projects.  This  “degree  of  realization”  will  not 
become  part  of  the  decision  support  tool  since  it  is  dependent  on  the  importance  and 
aggressiveness  of  each  goal.  The  consequences,  however,  are  completely  described  by 
the  seven-point  schedule  in  question  ten  of  the  questionnaire. 

4.8.2  Importance 

Question  nine  in  the  survey  asked  respondents  to  rate  the  importance  of  several 
outsourcing  motivations.  Table  1 1  shows  the  motivations  in  rank  order  from  most 
important  to  least  important.  Using  a  one-sample  T-test,  each  mean  was  compared  to  one 
(the  value  for  “not  important”).  Each  motivation  passed  this  test  at  the  95%  confidence 
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level.  Success  at  the  95%  confidence  level  indicates  respondents  believed  each  goal  was 
something  more  than  “not  important.”  Another  T-test  comparing  the  sample  means  to 
three,  the  value  for  “somewhat  important,”  shows  that  keeping  stable  staffing  levels, 
sharing  risks  with  outsourcing  vendors,  and  improving  cash  flow  are  considered 
significantly  less  than  “somewhat  important.” 


Goal 

Importance 

Acquire  Expertise  not  Available  In-house 

3.61 

Reduce  Schedule  (Vendor  Faster) 

3.30 

Improve  Responsiveness  to  Organizational  Objectives 

3.29 

Improve  Responsiveness  to  Customer  Objectives 

3.21 

Add  People  (insufficient  in-house  capacity) 

3.15 

Improve  Product  Quality 

3.10 

Reduce  Schedule  (through  parallel  activities) 

3.06 

Improve  Control  over  Project  Management 

2.75 

Non-Core  Activities 

2.63 

Add  People  (short-term) 

2.54 

Reduce  Cost  (via  economies  of  scale) 

2.54 

Keep  Staffing  Levels  Stable 

2.48 

Risk  Sharing 

2.35 

Cash  Flow  from  Sale  of  Product  Rights 

1.49 

Table  11:  Respondents’  Outsourcing  Motivations 


Survey  respondents  identified  several  other  outsourcing  goals  not  included  in  the 
original  questionnaire.  Most  of  these  goals  can  be  considered  restatements  of  goals  from 
the  survey  or  variations  on  the  same  theme.  First,  three  respondent  organizations 
expected  to  use  outsourcing  to  improve  development  processes  and  standards.  Each 
respondent  listed  the  aim  of  improving  development  processes  and  standards  as  an 
important  goal,  with  two  not  meeting  expectations  and  one  significantly  better  than 
expectations.  Several  other  responses  such  as  testing  potential  partner  organizations, 
adding  to  development  team  prestige,  synergy  with  other  systems,  and  outsourcing  as  a 
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development  strategy  indicate  the  long-range  implications  of  outsourcing.  Outsourcing 
to  meet  the  expected  level  of  development  change  traffic,  shifting  blame  in  the  event  of 
project  failure,  and  finding  an  outsourcing  vendor  in  a  specific  country  are  tactical  uses  of 
outsourcing  at  the  project  level.  In  the  response  that  indicated  a  goal  of  finding  a  vendor 
in  a  specific  country,  the  motivation  was  not  to  develop  a  partnership  or  improve  the 
project  but  to  meet  a  requirement  to  include  indigenous  vendors  in  order  to  win  a 
development  contract  with  that  country’s  government.  All  of  the  other  goals  listed  by 
respondents  are  shown  in  Figure  22. 


Number  of 

Other  Outsourcing  Goal 

Respondents 

Importance 

Results 

Improve  development  processes  and 

3 

5 

2 

standards 

4 

4 

5 

1 

Ability  of  vendor  to  handle  expected 
volume  of  changes 

1 

5 

1 

Hiring  a  vendor  of  a  specific  nationality  to 
help  win  contract  with  that  nation’s 
government. 

1 

5 

4 

Field  support 

1 

3 

3 

Test  vendor  as  potential  long-term  partner 

1 

3 

3 

Achieve  knowledge  transfer  from  vendor 

1 

3 

3 

Add  prestige  to  development  team 

1 

4 

4 

Realize  synergy  with  other  systems 

1 

4 

3 

Shift  blame  to  vendor  for  potential  project 
failure 

1 

5 

2 

Part  of  development  strategy 

1 

4 

2 

Effectiveness  of  overall  project 

1 

4 

4 

Project  magnitude  too  large  for  single 
organization 

1 

5 

4 

Help  field  new  system 

1 

5 

1 

Figure  22:  Other  Outsourcing  Goals 
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4.8.3  Degree  of  Goal  Realization 

Respondents  were  asked  to  estimate  the  degree  to  which  their  outsourcing  goals 
were  realized  for  the  subject  project.  The  responses  were  based  on  a  five  point  Likert 
scale  shown  in  Table  12. 


Significantly 
Worse  than 
Expectations 

Exactly  on 
Target 

Significantly 
Better  than 
Expectations 

i 

2 

3 

4 

5 

Table  12:  Five-Point  Goal  Realization  Scale 


Table  13  shows  the  results  of  respondents  outsourcing  projects  in  terms  of  14 
outsourcing  goals.  The  results  are  presented  in  three  forms.  First,  the  table  is  divided 
into  shaded  and  un-shaded  goals.  The  shaded  goals  (first  nine  rows  in  Table  13)  have 
means  that,  according  to  a  one  sample  T-test,  are  not  significantly  different  from  three 
(exactly  on  target).  The  un-shaded  goals  are  significantly  less  than  exactly  on  target  and 
thus  do  not  typically  meet  respondents’  expectations  or  targets.  Second,  the  middle 
column  shows  the  numerical  mean  of  responses  for  each  goal.  Finally,  the  third  column 
shows  the  percentage  of  responses  that  were  positive.  In  this  case,  positive  is  defined  as 
greater  than  or  equal  to  three  since  three  is  defined  as  “exactly  on  target”  in  the  response 
scale  shown  in  Table  12.  Positive  responses  indicate  the  goal  result  was  equal  to  or  better 
than  expectations  or  targets.  The  relatively  high  percentage  of  positive  results  and  strong 
central  tendencies  indicate  a  tail  of  negative  responses  lowering  the  mean  result  for  most 
goals. 
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Goal 

Result 

Mean 

Percentage  of 
Positive 
Responses 

Acquire  Expertise  not  Available  In-house 

3.14 

79% 

Non-Core  Activities 

3.08 

83% 

Add  People  (insufficient  in-house  capacity) 

3.06 

81% 

Add  People  (short-term) 

2.93 

83% 

Keep  Staffing  Levels  Stable 

2.93 

83% 

Improve  Responsiveness  to  Organizational  Objectives 

2.71 

62% 

Improve  Responsiveness  to  Customer  Objectives 

2.65 

59% 

Risk  Sharing 

2.65 

67% 

Improve  Product  Quality 

2.63 

66% 

Cash  Flow  from  Sale  of  Product  Rights 

74% 

Reduce  Schedule  (through  parallel  activities) 

2.54 

43% 

Improve  Control  over  Project  Management 

2.54 

57% 

Reduce  Cost  (via  economies  of  scale) 

2.54 

57% 

Reduce  Schedule  (Vendor  Faster) 

2.42 

48% 

Table  13:  Results  of  Outsourcing  Goals 


It  is  clear  from  the  low  averages  and  significant  percentages  of  negative  responses 
shown  in  Table  13  that  outsourcing  frequently  fails  to  meet  schedule  reduction  goals. 
Although  most  respondents  indicated  meeting  or  exceeding  cost  reduction  and  control 
over  project  management  goals,  a  significant  percentage  of  respondents  experienced  poor 
results  in  these  areas. 


4.8.4  Prediction  of  Goal  Realization 

The  survey  data  was  analyzed  using  regression  models  and  neural  network 

techniques  to  determine  which  strategy  variables  can  be  suggested  as  predictors  for  a 
project’s  ability  to  meet  outsourcing  goals. 

Potential  inputs  to  each  regression  model  included  the  processes  outsourced, 
software  domains,  and  products  outsourced.  Each  goal  outcome  was  subjected  to  a  step¬ 
wise  linear  regression  to  ensure  only  significant  factors  were  selected  for  each  rule.  The 
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resulting  amounts  of  variance  explained,  R  Square,  are  lower  than  originally  expected 
because  of  the  choice  of  using  stepwise  regression  rather  than  simply  entering  each 
possible  factor  into  the  regression  model.  The  latter  choice  would,  however,  produce 
models  explaining  a  high  percentage  of  the  dependent  variable’s  variance  but  with 
potentially  flawed  input  from  statistically  insignificant  factors.  A  standard  95  percent 
confidence  level  was  chosen  to  accept  a  variable  into  the  model  at  each  step  with  a 
corresponding  90  confidence  required  to  subsequently  remove  factors  (Devore  ). 
Complete  listings  of  these  regression  statistics  are  shown  in  Appendix  B. 

The  following  sections  will  describe  the  regression  results  for  each  goal  and 
require  some  explanation.  Items  on  the  left  side  of  each  diagram  represent  the 
statistically  significant  factors  that  affect  the  project  goals  (shown  on  the  right  side  of 
each  diagram).  On  the  left  side  of  each  diagram,  domain  factors  are  shown  in  rectangles 
with  rounded  comers,  process  factors  are  shown  in  plain  rectangles,  and  product  factors 
are  rectangles  with  curved  lines  on  the  bottom.  Outsourcing  goals  and  consequences  are 
shown  alone  on  the  right  side  of  each  diagram.  The  lines  between  factors  and  goals 
represent  the  relationships  and  are  annotated  with  either  a  plus  or  minus  sign.  The  sign 
represents  the  direction  the  factor  impacts  its  related  goal.  For  example,  the  minus  sign 
in  Figure  23  indicates  that  projects  in  the  systems  sub-domain  of  device  drivers 
correspond  with  a  reduced  ability  to  meet  their  product  quality  improvement  goals. 

4.8.4. 1  Product  Quality 

The  first  regression  analysis  yielded  a  model  to  predict  a  project’s  ability  to  meet 
product  quality  improvement  goals.  While  the  model  only  explains  a  small  amount  of 
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variance  it  is  interesting  to  note  both  the  regression  constant  factor  and  the  software 
domain  influence.  The  constant  (2.729)  suggests  product  quality  improvement  is  nearly 
on-target.  The  only  significant  factor  was  that  outsourcing  projects  within  the  device 
driver  sub  domain  correlates  with  a  significant  reduction  in  ability  to  meet  quality 
improvement  expectations  (Figure  23). 
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DOMAIN  -  Systems  - 

1  * 

Product  Quality 

Device  Drivers 

9  % 

9 

Improvement 
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Figure  23:  Factor  Associated  with  Likelihood  of  Meeting  Product  Quality 

Improvement  Goals 


4. 8.4.2  Non-Core  Activities 

Most  respondent  outsourcing  strategies  resulted  in  meeting  organizational  targets 
for  outsourcing  non-core  activities.  Only  device  drivers  and  COTS  projects  were 
significantly  correlated  with  a  reduction  in  the  ability  to  meet  goals  of  offloading  non¬ 
core  effort  (Figure  24). 


Figure  24:  Factors  Associated  with  Likelihood  of  Meeting  Offloading  of  Non-Core 

Activities  Goals 
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4. 8.4. 3  Acquire  Outside  Expertise 

Respondents  identified  acquiring  expertise  not  available  in-house  as  the  most 
important  goal  for  outsourcing  software  developments.  The  predictors  for  the  result  of 
this  important  goal  include  positive  correlation  with  projects  in  the  systems  domain  and 
those  that  include  outsourcing  the  reengineering  process  (Figure  25).  Projects  in  the 
commercial  (shrink-wrap)  Internet  sub  domain  have  significant  negative  correlation  with 
decreased  ability  to  acquire  outside  expertise.  These  factors  indicate  that  respondents  in 
the  systems  domain  have  been  better  able  to  find  outside  expertise  than  the  commercial 
Internet  sub  domain — perhaps  because  of  a  scarcity  of  Internet  expertise  or  demand  for 
such  talent. 


Figure  25:  Factors  Associated  with  Likelihood  of  Meeting  Goals  of  Acquiring 

Outside  Expertise 


4. 8.4. 4  Control  over  Outsourced  Project  Management  Process 

Researchers  suggest  some  software  development  is  outsourced  to  take  back 
control  over  projects  that  was  lost  to  in-house  developers  (W.  Jones  ).  Respondents 
indicated  this  control  was  “somewhat  important.”  Reengineering  efforts  seem  to  enhance 
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this  control  while  outsourcing  the  requirements  process  reduces  an  organization’s  ability 
to  meet  goals  for  controlling  the  development  process  (Figure  26). 


Figure  26:  Factors  Associated  with  Likelihood  of  Meeting  Goals  to  Increase  Control 
Over  Outsourced  Project  Management  Process 


4.8.4. 5  Cash  Flow 

Respondents  clearly  indicated  outsourcing  with  the  goal  of  achieving  cash  flow 
was  unimportant  to  them.  Two  negative  factors  were  found  to  aid  in  the  prediction  of 
meeting  goals  of  cash  flow  benefits  from  outsourcing.  Device  driver  projects  and 
interactive  web  site  development  projects  both  correlate  with  strong  reductions  in  ability 


to  meet  cash  flow  goals  (Figure  27). 


Figure  27:  Factors  Associated  with  Achieving  Cash  Flow  Goals 
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4. 8. 4. 6  Add  More  Personnel  (Insufficient  In-House  Capacity) 

At  the  95  percent  confidence  level,  no  significant  factors  were  found  to  predict  the 
ability  to  meet  the  goal  of  adding  more  project  personnel  to  overcome  insufficient  in- 
house  capacity.  Not  finding  any  significant  influence  factors  implies  that  neither  domain, 
product  type,  nor  processes  outsourced  significantly  impact  an  organization’s  ability  to 
add  more  personnel  through  outsourcing  when  the  in-house  capacity  is  insufficient. 

4. 8. 4. 7  Add  More  Personnel  (Short-Term  Need) 

Adding  project  personnel  because  of  a  short-term  need  is  less  important  to 
respondents  than  adding  due  to  insufficient  in-house  capacity.  The  types  of  products  and 
projects  involved  in  the  outsourcing,  however,  significantly  impact  it  (Figure  28). 
Customization  of  common  applications  appears  to  indicate  a  reduction  in  ability  to  add 
more  personnel  for  a  short  term  need.  In  contrast,  projects  in  the  accounting  system  sub 
domain  correlate  with  an  improved  ability  to  add  personnel.  The  positive  correlation 
between  projects  in  the  accounting  system  sub  domain  and  a  project’s  ability  to  meet 
goals  of  adding  personnel  may  represent  domain  labor  availability  more  than  any  other 
aspect  of  accounting  systems. 
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Figure  28:  Factors  Associated  with  Achieving  Goals  for  Adding  Personnel  Due  to 

Short-Term  Shortages 


4.8.4. 8  Responsiveness  to  Organizational  Objectives 

Similar  to  control  over  the  development  process,  improving  responsiveness  to 
organizational  objectives  was  suggested  as  an  outsourcing  motivation  (Thomsett 
"Outsourcing:  The  Great  Debate" ).  Projects  in  the  device  driver  sub  domain  indicate 
reduced  ability  to  improve  responsiveness  (Figure  29).  Outsourcing  software  engineering 
support  also  indicates  reduced  ability  to  meet  this  goal.  Finally,  outsourcing  the  coding 


process  correlates  with  an  improved  ability  to  meet  this  goal. 


Figure  29:  Factors  Associated  with  Meeting  Goals  of  Improving  Responsiveness  to 

Organizational  Objectives 
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4. 8. 4. 9  Risk  Sharing 

While  several  authors  suggest  outsourcing  as  a  means  of  risk  sharing,  survey 
respondents  indicated  this  was  not  a  significantly  important  goal  for  their  outsourcing 
arrangements.  Outsourcing  software  engineering  support  was  the  only  significant  factor 
related  to  an  organization’s  reduced  ability  to  meet  risk-sharing  goals  (Figure  30). 


Figure  30:  Factor  Associated  with  Ability  to  Meet  Outsourcing  Risk  Sharing  Goals 

4.8.4.10  Stable  Staffing  Levels  and  Personnel  Turnover 

Statistical  analysis  indicates  outsourcing  only  processes  (rather  than  products), 
maintenance,  and  reengineering  enhance  an  organization’s  ability  to  meet  its  goal  of 
maintaining  stable  staffing  levels  (Figure  31).  Outsourcing  configuration  management, 
however,  correlates  to  a  significant  reduction  in  ability  to  meet  goals  of  stable  staffing 


levels. 
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Figure  31:  Factors  Associated  with  Meeting  Goals  of  Maintaining  Stable  In-House 

Staffing  Levels 


4.8.4. 1 1  Responsiveness  to  Customer  Objectives 

Respondents  indicated  improved  responsiveness  to  customer  objectives  is  an 
important  motivation  for  software  outsourcing  (Section  4.8.2).  Outsourcing  software 
engineering  support  and  projects  in  the  device  driver  sub  domain  appear  to  hinder  an 
organization’s  ability  to  make  this  improvement  (Figure  32).  In  contrast,  outsourcing  in 
the  order  entry  system  and  avionics  sub  domains  enhanced  an  organization’s  ability  to 
improve  responsiveness  to  their  customers. 
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Figure  32:  Factors  Associated  with  Ability  to  Meet  Responsiveness  to  Customer 

Objective  Goals 


4.8.4.12  Development  Schedule 

Respondents  clearly  showed  reduction  of  development  schedule  to  be  an 
important  goal  for  software  outsourcing.  When  respondents  expected  to  reduce  schedule 
duration  due  to  vendor  efficiencies,  outsourcing  the  requirements  process  enhanced  their 
project’s  ability  to  meet  this  goal  (Figure  33).  Using  outsourcing  to  increase  parallel 
activities  and  thus  schedule  duration  was  less  important  and  hindered  when  software 
engineering  support  was  outsourced  and  enhanced  for  projects  in  the  avionics  sub  domain 
(Figure  34). 
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Figure  33:  Factor  Associated  with  Ability  to  Meet  Goals  of  Reducing  Development 

Schedule  by  Using  Faster  Vendors 


Figure  34:  Factors  Associated  with  Ability  to  Meet  Goals  of  Reducing  Development 
Schedule  by  Increasing  Parallel  Activities 


4.8.4.13  Project  Cost 


Respondents  placed  cost  reduction  far  down  their  list  of  outsourcing  goals. 
Outsourcing  the  fielding  process  is  the  only  significant  factor  associated  (negatively)  with 
an  organization’s  ability  to  meet  cost  reduction  goals  (Figure  35). 


Figure  35:  Factor  Associated  with  Meeting  Goals  of  Reducing  Project  Costs 

Through  Outsourcing 
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4.8.5  Results 

Figure  36  shows  the  results  of  outsourcing  in  terms  of  specific  project  goals. 

Since  goal  satisfaction  is  partially  dependent  on  the  aggressiveness  of  the  outsourcing 
goal,  relative  consequences  compared  to  in-house  projects  are  a  better  measure  of 
outsourcing  performance.  The  results  are  not  terribly  encouraging.  Schedule  flexibility 
is  the  single  consequence  that  improved  for  more  than  50  percent  of  the  outsourced 
projects  (as  compared  to  in-house  experiences).  When  the  neutral  responses  are  added, 
however,  the  results  became  somewhat  more  positive.  Using  that  criterion,  only 
“visibility  into  the  development  process”  fails  to  meet  or  exceed  in-house  experiences  for 
50  percent  of  the  outsourced  projects  [Figure  37]. 


non  core  add  people  add  people  staff  stable  expertise  quality  risk  share  response  response  control  reduce  cost  reduce  reduce 
capacity  short  org  cust  economies  sched  sched 

vendor  parallel 


Goal 


Figure  36:  Outsourcing  Goal  Satisfaction 
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Figure  37:  Outsourcing  Consequences 


4.9  Consequences 

The  outcomes  of  outsourcing  projects  were  analyzed  using  regression  and  neural 
network  techniques  to  produce  prediction  rules  for  a  decision  support  tool.  Potential 
inputs  to  each  regression  model  included  the  processes  outsourced,  software  domains, 
and  products  outsourced.  Each  outcome  was  subjected  to  a  step-wise  linear  regression  to 
ensure  only  significant  factors  were  selected  for  each  rule.  The  resulting  amounts  of 
variance  explained,  R  Square,  are  lower  than  originally  expected  because  of  the  choice  of 
using  stepwise  regression  rather  than  simply  entering  each  possible  factor  into  the 
regression  model.  The  latter  choice  would,  however,  produce  models  explaining  a  high 
percentage  of  the  dependent  variable’s  variance,  but  with  potentially  flawed  input  from 
statistically  insignificant  factors.  A  95  percent  confidence  level  was  chosen  to  accept  a 
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variable  into  the  model  at  each  step  with  a  corresponding  90  confidence  required  to 
subsequently  remove  factors.  The  notation  follows  the  same  format  as  described  in 
Section  4.8.4. 

4.9. 1 . 1  Administrative  Overhead 

Respondents  indicated  a  slightly  higher  level  of  administrative  overhead 
associated  with  outsourcing  in  general.  While  outsourcing  documentation  efforts 
correlated  with  reduced  levels  of  administrative  overhead,  projects  in  the  enterprise 
manufacturing  and  shrink-wrap  utilities  sub  domains  showed  significant  association  with 
increased  administrative  overhead  (Figure  38). 


Figure  38:  Factors  associated  with  Administrative  Overhead 


4.9. 1 .2  Control  over  Final  Product 

Intuitively,  one  expects  that  offloading  software  development  work  to  outsource 
developers  would  reduce  a  manager’s  control  over  the  final  software  product,  but 
Thomsett  contends  that  some  organizations  turn  to  outsourcing  because  in  house 
developers  have  established  their  own  agenda  and  subsequently  failed  to  meet  user  needs 
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and  requirements  (Thomsett  "Outsourcing:  The  Great  Debate" ).  Survey  respondents 
reported  a  slightly  lower,  albeit  not  significantly  lower,  average  level  of  control  over  the 
final  product.  Outsourcing  customized  versions  of  common  applications  correlates  with 
further  reduced  control  over  the  final  product.  In  contrast,  outsourcing  software 
maintenance  corresponds  to  increased  control  over  the  final  product  (Figure  39). 


Figure  39:  Factors  associated  with  Control  over  the  Final  Product 


4.9. 1 .3  Control  over  Outsourced  Project  Management  Process 

Respondents  also  indicated  that  control  over  the  project  management  process  is 
slightly  higher  for  outsourcing  projects.  Outsourcing  the  design  process  correlated  with 
drastically  reduced  control  while  respondents  indicated  that  projects  outsourcing 
reengineering  correlated  strongly  with  improved  control  of  the  project  management 
process.  Analysis  also  suggests  that  outsourcing  in  the  software  component  development 
domain  and  customized  versions  of  common  applications  was  associated  with  a 
significant  reduction  in  process  control  (Figure  40). 
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Figure  40:  Factors  Affecting  Control  over  Outsourced  Project  Management 


4.9. 1 .4  Costs  Associated  with  Changes 

Respondents  reported  significantly  increased  levels  of  costs  associated  with 
changes  during  the  outsourcing  project  compared  to  similar  costs  for  changes  on  an  in- 
house  development.  The  problem  of  excessive  costs  from  design  and  requirement 
changes  also  plagues  engineering  contract  development.  Projects  in  the  operating 
systems  sub  domain  of  software  component  development  correlated  with  additional 
increases  in  change  costs  (Figure  41). 


Figure  41:  Factor  related  to  Costs  associated  with  Changes 
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4.9. 1 .5  Cultural,  Location,  and  Language  Problems 

The  likelihood  of  cultural,  location-related,  or  language-based  problems  were 
significantly  higher  for  outsourced  software  developments  than  for  in-house  efforts. 
Clearly  the  main  factor  here  was  outsourcing  to  organizations  in  different  countries  with 
different  languages.  In  this  analysis,  outsourcing  shrink-wrap  utilities  and  avionics 
software  projects  also  corresponded  to  additional  increases  while  outsourcing  software 
component  development  related  to  lower  levels  of  these  problems.  Presumably,  projects 
in  the  shrink-wrap  utilities  and  avionics  sub  domains  were  more  likely  to  be  offshore 
efforts  than  projects  in  other  domains  (Figure  42). 


Figure  42:  Factors  relating  to  Cultural,  Location,  and  Language  Problems 


4.9. 1 .6  Development  Risks 

While  several  authors  suggested  outsourcing  as  a  means  of  risk  sharing,  survey 
respondents  indicated  this  was  not  a  statistically  significant  goal  for  their  outsourcing 
arrangements.  Projects  in  the  enterprise  software  domain,  systems  software  domain,  and 
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those  outsourcing  configuration  management  tasks  all  correlate  with  improved  (reduced) 
outsourcing  development  risk  levels  (Figure  43). 


Figure  43:  Factors  Related  to  Development  Risks 


4.9. 1 .7  Development  Schedule 

Respondents  clearly  showed  that  reduction  of  development  schedule  was  an 
important  goal  for  software  outsourcing.  Unfortunately,  none  of  the  observed 
independent  variables  correlated  with  significant  changes  in  development  schedule. 
Overall,  respondents  indicated  no  significant  difference  in  project  duration  between  in- 
house  and  similar  outsourced  projects. 

4.9. 1.8  In-House  Effort  Spent  on  Non-Core  Activities 

Respondents  indicated  outsourcing  projects  have  significantly  less  in-house 
administrative  overhead  than  traditional  in-house  projects.  Two  factors  appear  to 
mitigate  this  improvement  (Figure  44).  First,  software  projects  in  the  interactive  web-site 
development  sub  domain  correlate  to  increased  in-house  overhead.  Second,  outsourcing 
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COTS  products  correlated  with  increased  overhead.  These  results  were  consistent  with 
an  intuitive  understanding  of  the  extra  effort  required  to  integrate  COTS  products  into  a 
comprehensive  system  and  the  need  to  clearly  communicate  in-house  information  for 
interactive  web-site  development.  Overall,  the  idea  that  outsourcing  projects  had  less 


administrative  overhead  than  similar  in-house  projects  was  one  of  the  attractive  features 
of  outsourcing. 


Figure  44:  Factors  Affecting  Non-Core  Activities 

4.9. 1 .9  In-House  Personnel  Turnover 

Respondents  indicated  no  significant  change  in  personnel  turnover  levels  between 
in-house  and  outsourced  software  development  projects.  Outsourcing  development  of 
CASE  tools  corresponded  to  decreased  in-house  turnover  levels  while  outsourcing  the 
software  engineering  support  process  slightly  increased  in-house  personnel  turnover 
levels  (Figure  45). 
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Figure  45:  Factors  associated  with  In-House  Personnel  Turnover 

4.9.1.10  Intellectual  Capital 

Respondents  indicated  no  significant  change  in  their  organizations’  rights  to 
software  products  developed  via  outsourcing  compared  to  in-house  developed  products. 
The  analysis  showed  that  outsourcing  the  fielding  process  corresponds  to  reduced 
intellectual  capital  rights  while  outsourcing  the  training  process  correlates  with  increased 
rights.  In  general,  a  combination  of  both  product  and  process  outsourcing  was 
surprisingly  found  to  be  significantly  related  to  reduced  intellectual  capital  rights.  The 
researcher  expected  to  see  a  negative  correlation  between  product  outsourcing  and 
intellectual  capital.  Several  software  domains  and  sub  domains  demonstrated  correlation 
with  significant  positive  and  negative  impacts  of  intellectual  property  rights  (Figure  46). 
Mainly  intellectual  capital  is  a  consequence  of  the  contract  vehicle  agreed  to  by  the 
vendor  and  purchasing  organization. 
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Figure  46:  Factors  associated  with  Intellectual  Capital  Rights 


4.9. 1.11  Likelihood  of  a  Failed  or  Cancelled  Project 

Demarco  and  Lister  contend  that  nearly  thirty  percent  of  outsourced  software 
projects  result  in  dissatisfaction  or  failure  (Demarco  and  Lister ).  Respondents  to  this 
survey  indicated  no  significant  difference  between  failure  levels  of  outsourced  projects 
and  in-house  efforts.  Outsourcing  tool  support  did,  however,  correspond  to  an  increased 
failure  possibility.  In  contrast,  outsourcing  configuration  management  and  software 
engineering  support  processes  correlated  to  a  significantly  reduced  likelihood  of  project 
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failure  (Figure  47).  One  possible  explanation  is  that  organizations  outsourcing  support 
processes  are  more  likely  to  have  higher  process  maturity  levels  and  thus  better 
understand  the  need  for  thorough  process  definitions. 


Figure  47:  Factors  associated  with  the  Likelihood  of  a  Failed  or  Cancelled  Project 

4.9.1.12  Product  Quality 

A  regression  model  was  used  to  help  predict  product  quality  on  the  seven-point 
Likert  scale.  The  results  are  shown  in  Appendix  A.  In  this  case,  product  quality  begins 
slightly  above  ‘No  Change’  on  the  response  scale.  Outsourcing  COTS  products 
correlates  to  a  significant  reduction  in  product  quality  while  outsourcing  reengineering 
efforts  suggests  product  quality  improvement  (Figure  48). 
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Figure  48:  Factors  Affecting  Product  Quality 


4.9.1.13  Project  Cost 

Respondents  placed  cost  reduction  as  the  fourth  least  important  of  the  14 
outsourcing  goals.  Outsourcing  CASE  tool  products  in  the  software  component  domain 
correlates  with  a  reduction  in  total  project  cost  while  custom  products  and  projects  in  the 


enterprise  manufacturing  domain  correlate  with  increased  project  costs  (Figure  49). 


Figure  49:  Factors  associated  with  Project  Cost 
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4.9.1.14  Project  Learning  Curve 

Brooks  argued  that  adding  personnel  to  a  late  software  project  makes  it  even  later 
(Brooks  ).  Outsourcing  software  development  efforts  are  similar  to  adding  new  project 
personnel  with  concerns  over  domain  knowledge,  experience,  and  effort  required  to  attain 
acceptable  productivity  levels.  For  this  survey’s  purposes,  a  long  (high)  learning  curve 
implies  slower  time-to-productivity.  Thus  a  reduction  in  learning  curve  is  considered  an 
improvement  and  means  that  project  personnel  gain  project  knowledge  more  quickly. 
According  to  survey  respondents,  the  outsourced  project  learning  curve  is  not 
significantly  different  than  in-house  learning  curves.  Only  outsourcing  order  entry 
systems  correlated  to  a  change  (reduction)  in  the  outsourced  learning  curve  (Figure  50). 
This  implies  faster  learning  on  these  projects  and  makes  sense  because  of  the  high  level 
of  definition  of  order  entry  systems  compared  to  other  less  established  software  domains. 


Figure  50:  Factor  associated  with  Project  Learning  Curve 


4.9.1.15  Responsiveness  to  Customer  Objectives 

Respondents  indicated  improved  responsiveness  to  customer  objectives  is  an 
important  aspect  of  software  outsourcing.  Outsourcing  software  engineering  support 
correlates  with  reduced  responsiveness  to  customer  objectives  (Figure  51). 
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Figure  51:  Factors  Related  to  Responsiveness  to  Customer  Objectives 


4.9.1.16  Responsiveness  to  Organizational  Objectives 

Similar  to  control  over  the  development  process,  improving  responsiveness  to 
organizational  objectives  was  shown  to  be  an  outsourcing  motivation  (Section  4.8). 
Figure  52  shows  that  only  outsourcing  software  engineering  support  correlates  with  a 
change  (reduction)  in  responsiveness  to  organizational  objectives. 


Figure  52:  Factors  Affecting  Responsiveness  to  Organizational  Objectives 

4.9.1.17  Rework 

As  shown  in  Table  13,  survey  respondents  identified  no  significant  difference 
between  the  level  of  rework  required  for  in-house  and  outsourced  projects.  Regression 
analysis  did,  however,  show  that  COTS  products  and  projects  in  the  software  component 
development  domain  correspond  to  increased  rework  levels  (Figure  53). 
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Figure  53:  Factors  associated  with  Rework 


4.9.1.18  Schedule  Flexibility 

Again,  respondents  identified  no  significant  difference  between  an  in-house 
project’s  schedule  flexibility  and  that  of  outsourced  software  development  projects. 
Outsourcing  projects  in  the  accounting  sub  domain  of  enterprise  systems  correlated  with 
significantly  higher  project  schedule  flexibility  (Figure  54). 
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Figure  54:  Factor  associated  with  Schedule  Flexibility 

4.9. 1.19  Cross-Functional  Conflicts 

Respondents  strongly  supported  an  initial  contention  that  increasing  the  number 
of  organizational  lines  of  communication  and  boundaries  associated  with  outsourcing 
resulted  in  a  significantly  higher  likelihood  of  cross-functional  conflicts  (originally 
termed  “turf  wars”  in  the  survey)  within  the  development  project.  These  conflicts  arise 
from  misunderstandings  of  project  requirements,  a  lack  of  clearly  defined  organizational 
project  responsibilities,  and  unwillingness  to  accept  fault  for  mistakes  (or  desire  to  shift 
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blame).  While  outsourcing  software  engineering  support  and  tool  support  process 
correlated  with  further  conflicts,  projects  outsourcing  application  support  corresponded  to 
significantly  decreased  likelihood  of  these  problems  (Figure  55).  Finally,  outsourcing 
COTS  products  and  projects  in  the  enterprise  manufacturing  and  device  driver  sub 
domains  indicate  increased  likelihood  of  cross-functional  conflicts. 


Figure  55:  Factors  associated  with  Cross-Functional  Conflicts 


4.9.1.20  Visibility  into  the  Software  Development  Project 

Visibility  into  the  software  development  process  is,  on  average,  significantly 
reduced  for  outsourcing  projects  than  for  in-house  software  development  efforts. 
Respondents  indicated  that  outsourcing  reengineering  efforts,  not  outsourcing  products, 
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and  outsourcing  custom  products  corresponded  with  increased  visibility  into  the 
development  process  (Figure  56). 


Figure  56:  Factors  associated  with  Visibility  into  the  Software  Development  Project 

4.10  Assertions 

Section  IV  of  the  survey  asked  each  respondent  to  indicate  a  level  of  agreement 
with  specific  assertions  about  software  development  outsourcing.  The  first  grouping, 
relationship  assertions,  indicates  a  high  level  of  agreement  assertions  concerning: 

•  frequent  reviews 

•  communication  influence 

•  previous  working  experience 

•  visibility  into  vendor  processes,  and 

•  working  with  a  vendor  that  has  an  established  track  record  [Figure  57]. 

Only  distance  between  customer  and  vendor  showed  an  overall  negative  influence 
on  project  success.  The  negative  correlation  between  project  success  and  distance 
between  customer  and  vendor  organizations  indicates  the  “follow-the-sun”  and  24-hour 
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development  cycles  advertised  by  offshore  developers  are  less  appealing  than  their 
reduced  labor  costs. 


Figure  57:  Results  of  Relationship  Assertions 

The  second  grouping,  project  assertions,  also  yielded  positive  results.  Specific 
domains  apparently  lend  themselves  to  outsourcing,  vendor  tool  and  domain  experience, 
vendor  reuse  of  existing  products,  and  customer  domain  experience  clearly  improved  the 
likelihood  of  outsourcing  project  success  [Figure  58].  The  availability  of  many  vendors, 
larger  products,  and  larger  efforts  were  indicated  as  items  that  did  not  improve  an 
outsourcing  project’s  chances  for  success. 
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Figure  58:  Results  of  Project  Assertions 

The  goal/expectation  assertions  showed  that  aggressive  cost  and  schedule 
reduction  goals  detracted  from  project  success  [Figure  59].  The  implication  is  that 
modest  cost  and  schedule  reduction  expectations  are  more  realistic  for  outsourcing 


projects. 


Response  Rate 


76 


Goal  and  Expectation  Assertions 
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Figure  59:  Results  of  Goal  and  Expectation  Assertions 

Figure  60  shows  that  respondents  agreed  that  modular  products  are  better  suited 
for  outsourcing  projects  and  that  lower  complexity  products  also  increased  the  likelihood 
of  successful  outsourcing  development  projects. 
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Product  Related  Assertions 
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Figure  60:  Results  of  Product  Assertions 

Defining  organizational  responsibilities  and  interfaces  and  having  common 
methods  and  tools,  which  allow  for  seamless  information  flow  between  customer  and 
vendor,  improved  chances  for  outsourcing  success  [Figure  61].  The  remaining  process 
assertions  had  moderate  responses  indicating  project  improvement  and  less  than  ten 
percent  of  responses  indicating  reduced  project  success. 
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Figure  61:  Process  Assertions 
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The  product  assertions  were  even  clearer,  showing  all  but  component  size  had  a 
significant  impact  on  project  success  [Figure  62], 
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Figure  62:  Product  Assertions 


4.11  Results  Summary 

Data  from  the  survey  responses  were  analyzed  statistically  to  produce  a  new 
understanding  of  outsourcing  demographics,  decision-maker  roles,  motivations, 
outsourcing  strategies,  and  most  importantly  rules-of-thumb  which  can  be  used  to  predict 
the  outcome  of  software  development  outsourcing  projects.  Finally,  general  assertions 
about  outsourcing  relationships,  products,  and  projects  were  captured  to  help  suggest 
improvement  options  for  decision  support  tool  users. 
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The  data  presented  in  this  chapter  yielded  rules  (presented  in  Section  4.9)  and 
assertions  (discussed  in  Section  4.10)  that  will  help  outsourcing  decision  makers  (Section 
4.4)  select  appropriate  outsourcing  strategies  for  their  specific  project  needs.  The  rules 
and  assertions  were  next  encoded  in  a  decision  support  tool  to  allow  decision  makers  to 
perform  trade-off  analyses  among  different  strategies  and  relationship  management 
approaches.  Details  about  the  decision  support  tool  implementation  and  use  cases  are 
presented  in  Chapter  5. 


5.  Decision  Support  Tool 

A  simple  way  to  understand  the  taxonomy  is  by  using  a  rule-based  decision 
support  system.  Based  upon  survey  work,  project  situations  and  strategies  were 
correlated  with  success  or  failure  to  meet  individual  or  combined  groups  of  goals.  The 
resulting  rules  were  used  to  produce  a  decision  support  system  that  will  enable  users  to 
select  successful  outsourcing  strategies  for  their  project  scenario  and  goals.  Where 
possible,  these  rules  should  be  understandable  and  explainable  for  each  potential 
outcome.  Collection  of  this  foundational  data  will  result  in  a  more  complete 
understanding  of  the  causal  factors  for  success  in  outsourcing  software  developments. 

This  chapter  begins  with  a  presentation  of  tool  inputs,  outputs,  and  sample  use 
cases.  The  remainder  of  this  chapter  (Sections  5.4  through  5.6)  covers  the  specific  types 
of  rules  included  in  the  system,  implementation  decisions  made,  and  presents  a  brief  tool 
user’s  guide. 


5.1  Inputs 

While  each  project  is  unique,  they  can  be  grouped  according  to  common 
characteristics.  Current  literature  has  limited  information  about  outsourcing  success  and 
failure  for  case  study  projects.  The  authors  use  case  studies  to  improve  outsourcing 
relationship  management  without  considering  the  possible  impact  of  project  domain  and 
product  types.  The  outsourcing  rules  fill  these  gaps  and  classify  success  according  to 
outsourcing  goals  and  motivations.  The  survey  defined  project  scenario  variables  and  the 
collected  actual  values  that  serve  as  inputs  to  the  decision  support  tool. 
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5.1.1  Project  Domain 

Project  domain  refers  to  the  type  of  software  development  effort.  Examples 
include  engineering  support,  embedded  software,  shrink-wrap  desktop  applications, 
management  information  systems,  military  software,  communications  applications,  and 
networking  software.  Several  authors  have  suggested  some  of  these  domains  are  more 
appropriate  than  others  for  outsourcing.  Dedene  and  DeVreese  indicate  reengineering 
efforts  are  especially  conducive  to  successful  outsourcing  due  to  their  well-defined  nature 
(Dedene  and  DeVreese  ).  According  to  Wantanabe,  the  Japanese  corporation  OMRON 
had  success  outsourcing  projects  such  as  tools  and  utilities  for  operating  systems, 
business  and  manufacturing  applications,  and  applications  using  state-of-the-art 
technologies  (Watanabe ).  In  contrast,  OMRON  had  difficulty  with  outsourcing 
applications  that  required  domain  knowledge  (e.g.,  ATM  machines  and  public 
transportation  ticket  vending  machines).  Figure  63  shows  the  user  input  screen  for 
software  domain  entry.  The  domains  and  sub  domains  in  Figure  63  are  a  compilation  of 
the  statistically  significant  domain  factors  found  in  all  of  the  regression  rules. 
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Figure  63:  Software  Domains  Tool  Inputs 


5.1.2  Development  Processes  Outsourced 

The  next  step  for  users  is  to  enter  which  processes  they  plan  to  outsource.  Figure 
64  shows  the  user  selection  screen  for  inputting  which  processes  will  be  outsourced.  This 
input  forms  another  part  of  the  antecedent  values  that  are  activated  by  the  inference 


engine. 
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Figure  64:  Outsourced  Processes  Input  Screen 


5.1.3  Types  of  Product  Components  Outsourced 

As  previously  mentioned,  it  is  impossible  to  delineate  all  of  the  possible  product 

components  that  may  be  outsourced.  Instead,  Figure  65  shows  the  types  of  product 
components  that  might  be  outsourced.  Users  enter  their  particular  product  component 
type  as  the  final  main  input  to  the  rule-base. 
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Figure  65:  Input  Form  for  Outsourced  Product  Component  Types 


5.1.4  Goals 

While  specific  project  goals  are  not  entered,  after  activating  the  outsourcing  rule- 
base,  users  can  select  those  consequences  requiring  further  improvement.  This  input, 
shown  in  the  right  column  of  Figure  66,  determines  which  assertion  rules  are  activated  to 
produce  suggestion  for  improving  the  predicted  outsourcing  consequences.  In  Figure  66, 
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hypothetical  output  values  shown  in  Column  G  represent  points  on  same  seven-point 
response  scale  used  the  survey  and  shown  in  Figure  67.  Column  H  of  Figure  66  shows 
that  the  tool  user  has  expressed  an  interest  in  further  improving  the  consequence,  “control 


over  project  management  process.” 
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Figure  66:  Goal  Input  Screen 
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Figure  67:  Seven-Point  Response  Scale 
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5.2  Outputs 


5.2.1  Predicted  Consequences 

For  the  project  inputs  and  outsourcing  strategy,  heuristic  rules  identify  how  the 
consequences  of  a  scenario  will  differ  from  a  project  performed  completely  in-house.  For 
example,  if  a  goal  is  to  significantly  reduce  total  project  costs,  similar  historical 
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experience  will  be  used  to  suggest  whether  meeting  that  goal  is  likely.  Assertions  can 
then  be  activated  to  identify  suggestions  to  improve  each  consequence. 

5.2.2  Summary  of  Inputs 

In  addition  to  indicating  the  likelihood  of  goal  achievement,  the  tool  will 
summarize  the  user  inputs  (project  variables  and  outsourcing  strategy)  to  help  identify  the 
specific  scenario  and  ‘what-if  comparisons. 

5.2.3  Suggestion  of  Possible  Strategy  Modifications 

If  the  given  project  variables  and  strategy  do  not  meet  the  prioritized  goals,  the 

tool  can  use  its  assertions  to  suggest  strategy  changes  which  might  improve  the  likelihood 
of  meeting  these  goals.  The  assertions  account  for  several  factors  that  were  not  collected 
numerically  during  the  industry  survey.  Respondents  indicated  strong  agreement 
between  these  factors  and  several  consequences  as  discussed  in  Section  4.10. 

5.2.3. 1  Organizational  Domain  Expertise 

To  make  an  informed  outsourcing  decision,  a  manager  or  consultant  must  know 

the  customer  organization’s  capabilities  within  the  chosen  application  type.  For  example, 
the  world’s  foremost  avionics  software  developer  would  have  little  incentive  to  outsource 
work  they  lead  the  world  in,  but  may  choose  to  have  an  outside  vendor  produce  their  time 
and  expense  tracking  software. 
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5.23.2  Availability  of  Vendors  with  Domain  Expertise 

,  outsourcing  a  project  is  not  possible  if  no  software  developers  with  the  desired 
domain  experience  are  available.  This  factor  also  considers  whether  the  potential 
vendors  have  more  domain  expertise  than  in-house  developers. 

Another  aspect  of  domain  expertise  could  be  considered  programming  language 
or  development  tool  familiarity.  The  proposed  decision  support  system  allows  customers 
to  decide  for  example,  whether  to  outsource  the  maintenance  of  a  legacy  software  system 
written  in  an  outmoded  second-generation  programming  language. 


5.2.33  Project  Size 

The  overhead  required  to  manage  an  outsourcing  relationship  must  somehow  be 
offset  with  cost,  schedule,  staffing,  quality,  or  other  benefits  to  the  customer  organization. 
Apparently,  outsourced  projects  must  be  a  certain  minimum  effort  size  to  produce  these 
benefits.  According  to  Shrinkant  Inamdar,  the  second-in-command  at  Motorola’s  SEI 
level-5  Bangalore  facility, 

“No  offshore  outsourcing  venture  of  less  than  a  particular  size  will 
ever  be  successful,  for  various  reasons.  Some  of  the  important  reasons  are 
scalable  commitment,  perception  of  lack  of  growth  opportunities,  and 
hence,  lack  of  motivation,  inadequate  availability  of  buffer  resources  for 
risk  management,  inadequate  number  of  people  for  domain  expertise 
development  strategies,  and  lack  of  commitment  because  of  a  lack  of 
investment.  While  one  can  start  with  a  smaller  size,  all  plans  should 
preferably  be  aimed  at  increasing  the  size  beyond  this  critical  mass  as 
quickly  as  possible.  My  qualitative  analysis  makes  me  believe  that  this 
critical  size  is  at  least  25  developers,  and  can  be  as  high  as  100  depending 
on  the  environment.”  (Yourdon,  Rubin  and  Mohnot ) 

Greg  Peek,  another  outsourcing  practitioner,  stated,  “a  minimum  size  is  necessary 
to  demonstrate  the  costs  savings  involved”  (Yourdon,  Rubin  and  Mohnot ).  According  to 
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Peek,  a  project  must  be  at  least  four  person-years  of  effort  to  qualify  as  a  solid 
outsourcing  prospect. 

5.2. 3. 4  System  Project  Modularity 

When  an  organization  considers  outsourcing  a  product  component,  they  must 
understand  the  complexity  and  amount  of  interaction  between  the  subject  component  and 
the  remainder  of  the  software  product. 

5. 2. 3. 5  Personnel  Constraints 

The  variable,  personnel  constraints  captures  the  customer  organization’s  ability  to 
undertake  the  proposed  development  effort  in-house  or  to  hire  additional  in-house 
developers.  When  neither  of  these  situations  is  likely,  outsourcing  becomes  a  more 
promising  option. 

5.2. 3. 6  Cost  Constraints 

Nearly  every  author  suggests  costs  savings  as  one  of  the  prime  outsourcing 
motivations.  Anecdotes  of  low-cost,  offshore  development  houses  have  managers 
turning  to  outsourcing  in  increasing  numbers  (TJ.S.  And  Worldwide  Outsourcing  Markets 
and  Trends  1998-2003  ).  Jarzombek  indicates  that  organizations  should  only  outsource  if 
the  projected  cost  savings  is  greater  than  thirty  percent.  (Jarzombek  ).  Apparently, 
projections  are  often  overly  optimistic,  outsourcing  relationship  management  is  more 
effort  than  expected,  and  thus  end  results  are  typically  worse  than  initial  estimates. 
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5.2. 3. 7  Schedule  Constraints 

Like  cost  constraints,  schedule  reduction  is  a  key  outsourcing  motivation.  When 
time  is  critical  and  a  more  experienced,  larger  vendor  staff  can  produce  the  project  faster 
than  in-house  developers,  managers  will  choose  to  outsource. 

5.3  Example  Use  Cases 

During  development  planning,  a  software  development  project  manager  can  use 
the  tool  input  process  to  identify  the  project  variables,  prioritized  project  goals,  and 
possible  outsourcing  strategies.  Once  the  tool  is  run,  the  development  manager  can 
gauge  the  strategy’s  success  and  review  possible  modifications.  The  following 
hypothetical  scenarios  will  explain  how  a  software  development  project  manager  or 
consultant  will  use  the  tool. 

5.3. 1  Overall  Strategy  Planning 

The  United  States  Air  Force  has  decided  to  take  advantage  of  new  technology  and 
produce  the  C-18  cargo  aircraft.  After  concept  exploration  and  competitive  prototyping, 
Planes-R-Us  is  selected  as  the  prime  development  and  production  contractor.  While  the 
company  has  developed  many  previous  aircraft,  the  software  project  manager  is  under 
tremendous  schedule  pressure.  In-house  completion  projections,  based  on  current  in- 
house  staffing  levels,  extend  well  beyond  deadlines.  From  past  experience,  the  manager 
knows  that  system-level  software  testing  is  costly,  time  consuming,  and  is  not  one  of 
Planes-R-Us’  organizational  strengths.  On  the  surface,  it  seems  like  a  good  idea  to 
outsource  the  testing  effort  to  an  outside  vendor.  The  decision  seems  like  a  good  way  to 
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augment  current  personnel,  shorten  the  schedule  through  concurrency,  and  improve 
product  quality.  To  test  this  hypothesis,  the  manager  enters  the  project  information  into 
the  decision  support  tool  along  with  the  project  goals  (Table  14). 


Variable 

Input  Values 

Project  Domain 

Systems  Software  -  Engineering  Development  (Aircraft 
Flight  Control) 

Organizational  Domain 
Expertise 

Above  Average 

Availability  of  Vendors  with 
Domain  Expertise 

High 

Project  Size 

10,000  person-months 

Project  Modularity 

Well-  defined  interfaces 

Manpower  Constraints 

Not  enough  in-house  personnel  (and  unable  to  hire 
required  personnel) 

Cost  Constraints 

Cost  is  a  secondary  factor  (e.g.,  cost-plus  contract) 

Schedule  Constraints 

Current  in-house  schedule  is  unacceptable  and  should  be 
reduced  by  1 5  percent  or  more  to  meet  deadlines  or 
time-to-market  goals 

Effort  Levels 

Effort  is  distributed  across  phases  in  a  fashion  typical  for 
projects  in  this  domain 

Outsourcing  Strategy 

Keep  everything  in-house  except  outsource  system-level 
software  testing  (100  percent  of  the  testing  phase  effort) 

Prioritized  Project  Goals 

■  Schedule  reduction  of  15  percent  or  greater 

■  Increased  product  quality 

■  Reduce  in-house  effort  by  30  percent  or  more 

■  Cost  Reduction  of  20  percent  or  more 

Table  14:  Large  Embedded  Aircraft  Software  System  Use-Case  Inputs 


As  shown  in  Figure  68,  the  output  of  the  tool  would  identify  the  likelihood  of 
meeting  each  goal  in  the  prioritized  list.  The  example  output  is  based  on  a  simple, 
common  sense  rule  and  data  extracted  from  published  literature.  According  to  Jones, 
post  integration  testing  (system,  field,  and  acceptance)  averages  between  7.5  and  13 
percent  of  all  software  development  efforts  (C.  Jones  Applied  Software  Measurement: 
Assuring  Productivity  and  Quality ).  This  generalization  fits  because  the  project  manager 
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gave  the  tool  input  indicating  an  average  work  effort  distribution  across  development 
phases.  As  a  result,  outsourcing  of  the  system-level  testing  effort  alone  is  unlikely  to 
achieve  a  15  percent  schedule  reduction.  Figure  68  shows  the  tool  outputs  for  this 
scenario.  Notice  that  since  the  user  desires  significant  improvements  in  cost,  schedule, 
quality,  and  in-house  effort  levels,  Column  H  shows  the  user  requesting  further 
improvement.  Once  these  inputs  are  entered,  the  assertions  can  be  activated  to  identify 
the  suggestions  that  might  improve  these  consequences  (along  with  potential  side-effects 


of  each  suggestion).  The  macro  button  assigned  to  executing  the  assertions  is  shown  in 
Figure  69. 


E 

F 

G 

H 

1 

3 

CONSEQUENCES 

Input 

Values 

Output 

Values 

Would  you  like 
suggestions? 

Result 

Direction 

B 

control  over  final  product 

4 

No 

Worse 

B 

control  over  project  management  process 

4 

4.04 

No 

Better 

B 

intellectual  capital 

4 

3.75 

No 

Worse 

H 

product  quality 

4 

4.397 

Yes 

Better 

UL 

responsiveness  to  customer  objectives 

L  4 

4.407 

No 

Better 

El 

responsiveness  to  organizational  objectives  and  strategies 

4 

4.473 

No 

Better 

KB 

schedule  flexibility 

4 

4.107 

No 

Better 

KD 

visibility  into  the  software  development  process 

4 

'  2.623 

No 

Worse 

IB 

administrative  overhead 

4 

4.563 

No 

Worse 

KB 

costs  associated  with  changes 

4 

4.446 

No 

Worse 

KB 

cultural,  location,  and  language  problems 

4 

5.193 

No 

Worse 

KB 

development  risks 

4  " 

3.332 

No 

Better 

KB 

development  schedule 

4 

4 

Yes 

KB 

in-house  effort  spent  on  non-core  activities 

4 

3665" 

Yes 

Better 

m 

in-house  personnel  turnover 

4 

3.997 

No 

Better 

KB 

likelihood  of  a  failed  or  cancelled  project 

4 

3.957 

No 

Better 

El 

project  costs 

4 

3.652 

Yes 

Better 

ED 

project  learning  curve 

4 

4.221 

No 

Worse 

El 

rework 

.  4 

3.85 

No 

Better 

m 

turf  wars 

4 

4.166 

No 

Worse 

Figure  68:  Aircraft  Example  Tool  Outputs 
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Type  of 
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CONSEQUENCES 
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suggestions? 

Direction 

Consequence 

4 

control  over  final  product 

4 

2.642 

No 

Worse 

Good 

5 

control  over  project  management  process 

4 

404 

No 

Better 

Good 

6 

intellectual  capital 

4 

3.75 

No 

Worse 

Good 

7 

product  quality 

4 

4.397 

Yes 

Better 

Good 

8 

responsiveness  to  customer  objectives 

4 

4.407 

No 

Better 

Good 

9 

responsiveness  to  organizational  objectives  and  strategies 

4 

4.473 

No 

Better 

Good 

10 

schedule  flexibility 

4 

4.107 

No 

Better 

Good 

11 

visibility  into  the  software  development  process 

4 

2.623 

No 

Worse 

Good 

12 

administrative  overhead 

4 

4.563 

No 

Worse 

Bad 

13 

costs  associated  with  changes 

4 

4.446 

No 

Worse 

Bad 

14 

cultural,  location,  and  language  problems 

4 

5.193 

No 

Worse 

Bad 

15 

development  risks 

4 

3.332 

No 

Better 

Bad 

16 

development  schedule 

4 

4 

Yes 

Bad 

17 

in-house  effort  spent  on  non-core  activities 

4 

3.665 

Yes 

Better 

Bad 

'18 

in-house  personnel  turnover 

4 

3.997 

No 

Better 

Bad 

19 

likelihood  of  a  failed  or  cancelled  project 

4 

3.957 

No 

Better 

Bad 

20 

project  costs 

4 

3.652 

Yes 

Better 

Bad 

21 

project  learning  curve 

4 

4.221 

No 

Worse 

Bad 

77 

rework 

4 

3.85 

No 

Better 

Bad 

23 
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Figure  69:  Activating  the  Assertions 


Finally,  the  tool  identifies  strategy  modifications  that  can  improve  the  projects’ 
ability  to  meet  prioritized  goals.  One  such  suggestion  could  be  to  outsource  a  product 
component  to  another  vendor.  Given  a  large  enough  chunk  of  effort,  outsourcing  a 
product  component  apparently  has  the  potential  to  shorten  the  overall  development 
schedule.  The  suggestions  are  shown  in  Figure  70. 
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Suggestion  or  Situational  Variable 

Positive  Consequences 

(can  improve  the  following  consequences) 

Negative  Side-Effects 

(may  have  these  undesirable  side-effects) 

Outsourcing  development  of  software  in  a  domain  familiar  to  the 
vendor 

development  risks 

i likelihood  of  a  failed  or  cancelled  project 

| product  quality 

|  project  learning  curve 

Outsourcing  development  of  software  in  a  project  domain  with  many 
available  vendors 

project  costs  i 

Outsourcing  development  of  software  to  a  vendor  with  more 
experience  with  tools  or  languages. 

development  schedule 

in-house  effort  spent  on  non-core  activities 

project  learning  curve 

Outsourcing  development  of  software  to  a  vendor  with  reusable 
design  or  code  components. 

development  risks 

control  over  fi nal  product 

development  schedule 

project  costs 

project  learning  curve 

tuft  wars 

Outsourcing  development  of  software  when  the  vendor  has  a 
successful  track  record 

development  risks 

[likelihood  of  a  failed  or  cancelled  project 
[product  quality 

.  ------ . 

Figure  70:  Suggestions  for  the  Example  Aircraft  Scenario 


5.3.2  Deciding  Between  Alternatives 

A  consultant  for  the  All-American  Bicycle  Company  was  asked  to  determine  the 
best  strategy  for  acquiring  a  state-of-the-art  accounting  system.  While  the  company  has 
an  information  systems  department  that  develops  in-house  applications  and  writes  custom 
code  for  factory  controllers,  they  are  already  overworked  and  have  no  experience  in 
designing  an  accounting  system.  The  consultant  believes  that  designing  and  building  a 
custom  accounting  system  will  be  expensive  and  time-consuming  and  could  be  better 
accomplished  by  an  outside  vendor.  After  reviewing  the  marketplace,  the  consultant 
finds  three  interested  companies.  The  first  company  sells  standard  off-the-shelf 
accounting  products  -  which  do  not  exactly  meet  corporate  process  standards,  but  could 
possibly  be  used.  The  second  company  sells  customizable  accounting  packages.  Finally, 
the  third  vendor  has  vast  accounting  system  development  experience  and  can  create  a 
completely  custom  system  while  still  taking  advantage  of  knowledge  and  object  re-use. 
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As  in  the  previous  example,  the  consultant  enters  the  project  data  and  goals.  Next 
the  consultant  runs  the  decision  support  tool  once  for  each  possible  outsourcing  strategy 
and  determine  which  best  meets  the  company’s  goals. 

5.4  Knowledge  Base  Rules 

5.4.1  Project  Level  Rules 

The  rules  that  form  the  basis  of  the  decision  support  tool  were  shown  graphically 
in  Section  4.9.  The  rules  also  have  numerical  values  representing  the  coefficients  from 
the  regression  equations.  All  of  the  relevant  regression  information  is  shown  in 
Appendix  A.  The  regression  technique  was  chosen  over  a  promising  attempt  using  neural 
networks.  While  the  neural  models  performed  well,  there  was  no  means  for  ensuring 
only  the  significant  inputs  were  included,  the  network  topology  was  correct,  or  that  over¬ 
training  did  not  occur.  Additionally,  the  neural  models  were  not  explainable  and  thus 
could  not  provide  insight  into  which  factors  affect  outsourcing  consequences  and  why. 
The  entire  table  of  rules  is  located  in  Appendix  E.  Each  rule  shows  the  product,  process, 
and  domain  factors  that  impact  each  consequence  as  well  as  the  impact  coefficient. 

Figure  71  shows  two  sample  rules  from  Appendix  E.  Rule  one  states  that  for  projects 
that  involve  outsourcing  both  process  and  product  components,  manager’s  can  expect  a 
reduction  of  0.753  in  the  consequence  of  intellectual  capital.  The  regression  coefficient 
(0.753  in  this  case)  comes  from  the  7-point  scale  from  question  ten  on  the  survey 
instrument  and  reprinted  as  Figure  67.  Rule  one  implies  that  projects  that  outsource  both 
process  and  product  components  experience  a  slightly  lower  level  of  intellectual  capital. 


Take  special  notice  that  rule  1 6  is  composed  of  constants  from  the  regression  equation. 
These  constants  indicate  the  effect  any  outsourcing  has  on  consequences. 
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Rule  No 

Factors  (Antecedent) 

Consequent 

Effect 

Impact 

Direction 

1 

Both  Process  and  Product 
Outsourcing 

10.  Improved/Increased 
Intellectual  Capital 

0.753 

Small 

Negative 

(Degrading) 

2 

Domain  -  Enterprise 

6.  Reduced  Development 
Risks 

0.885 

Small 

Positive 

(Improving) 

Figure  71:  Outsourcing  Rule  Sample 


Rules  1,  7,  8,  10, 11,  13, 16,  21,  and  26  (shown  in  Appendix  E)  all  concern  the 
consequence  of  intellectual  capital  and  can  be  combined  to  form  a  single  formula  from 
the  regression  model.  The  entire  rule  for  the  intellectual  capital  consequent  can  be 
written  as: 

Intellectual  _  Capital  (outsourcing)  =  Intellectual  _  Capital(in  -  house )  +  0.826 
-0.753  *  (product_andjprocess_outsourcing) 

+0.867  *  (domain_shrinkwrap_business) 

-1 .265  *  (domain_shrinkwrap_utilities)  - 1 .48  *  (domaincomponentCASEtool) 
+1 .04  *  (domain_component_domain_framework)  -  0.323  *  (domain_systems) 

-1 .299  *  (process_fielding)  +  0.912  *  (process_training) 


The  signs  of  the  coefficients  indicate  whether  the  particular  factor  has  a  positive 
or  negative  effect  on  the  consequence.  While  increasing  intellectual  capital  is  considered 
an  improvement,  increases  in  other  consequences  such  as  schedule  duration  are  negative 
effects.  Where  Intellectual ^Capital (in-house)  is  the  expectation  of  intellectual  capital  for 
this  project  if  development  were  conducted  entirely  in-house.  The  remaining  variables 


are  defined  as: 
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product_and_process_outsourcing 

domain_shrinkwrap_business 

domain_shrinkwrap_utiIities 

domain_component_CASEtool 

domain_component_domain_framework 

domain_systems 

process_training 


V  1  if  True  OR 

0  if  False 


Each  consequence  has  a  similar  equation  that  can  be  found  in  the  coefficients 
section  of  each  regression  run  shown  in  Appendix  A. 

5.4.2  General  Outsourcing  Experience  Assertions 

Unlike  the  project  level  rules,  outsourcing  assertions  were  not  captured  in  a 
numerical  form.  Analysis  of  these  assertions  yielded  relationships  between  types  of 
projects  and  relationship  factors  compared  with  the  consequences  of  outsourcing  projects. 
These  relationships  were  used  to  produce  a  table  identifying  which  assertions  relate  to 
either  improvement  (IMP)  or  worsening  (WOR)  of  each  outsourcing  consequence.  This 
table  is  shown  in  Appendix  E. 


5.5  Implementation 

After  experimenting  with  several  implementation  platforms,  the  researcher  chose 
Microsoft  Excel  for  the  prototype  tool.  While  CLIPS  and  FuzzyClips  provided  excellent 
knowledge  base  features,  their  text-based  interface  would  have  required  an  extensive 
graphical  shell  to  make  the  tool  user  friendly.  The  final  implementation  uses  both  the 
spreadsheet  and  Visual  Basic  macro  features  of  Microsoft  Excel. 


97 


5.6  Tool  Usage 

This  tool  is  intended  to  provide  project  managers  with  a  means  to  plan 
outsourcing  projects  and  gauge  expectations  based  on  each  particular  project  scenario. 

To  accomplish  this  goal,  the  decision  support  tool  was  constructed  in  two  parts.  First, 
managers  enter  their  software  domain,  product  type,  and  select  which  processes  they  plan 
to  outsource.  From  that  information  the  tool  uses  straightforward  spreadsheet  functions 
to  calculate  the  expected  outcomes  of  the  software  project  as  an  offset  of  the  user’s 
expectations  for  an  in-house  project.  These  spreadsheet  functions  are  precise 
implementations  of  the  statistical  rules  discussed  in  the  previous  section.  At  any  time,  a 
user  may  choose  different  outsourcing  strategies  (processes  and  products  types)  and 
immediately  see  the  expected  changes  in  the  project  consequences. 

Once  a  final  set  of  outsourced  processes  and  product  types  have  been  reached,  a 
user  can  compare  the  consequences  with  their  needs  and  goals.  If  the  consequences  are 
not  yet  satisfactory,  the  user  can  pick  those  consequences  that  require  further 
improvement  and  execute  a  macro  to  activate  solutions  that  will  improve  those  specific 
consequences.  The  macro  produces  a  list  of  suggestions  with  their  associated  benefits 
and  drawbacks.  The  suggestions  come  from  the  survey  assertions  shown  in  Appendix  D. 

5.7  Decision  Support  Tool  Summary 

The  decision  support  tool  presented  in  this  chapter  implements  the  outsourcing 
rules-of-thumb  and  assertions  (shown  in  Chapter  4)  as  an  inference  engine  to  transform 
project  scenario  variables  into  expectations  for  outsourcing  consequences  that  were 
considered  important  by  survey  respondents.  The  tool  inputs,  outputs,  and  rules  are  all 
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drawn  directly  from  survey  analysis.  The  usage  scenarios  mirror  the  needs  of  decision 
makers  as  found  in  Section  4.4.  Chapter  6  presents  the  effort  necessary  to  demonstrate 
the  tool  and  its  underling  framework  were  valid  and  non-trivial. 


6.  Decision  Support  Tool  and  Framework  Validation 
This  section  outlines  the  methods  and  results  of  the  validation  effort.  The 
validation  consisted  of  comparisons  between  tool  outputs  and  both  expert  and  novice 
expectations  for  four  project  scenarios.  In  addition,  a  well-known  software  outsourcing 
consultant  from  the  Cutter  Consortium  Sourcing  Service  was  asked  to  review  the 
outsourcing  rules  and  assertions  to  compare  them  with  his  vast  experience. 

6.1  Decision  Support  Tool  Validation  Literature 
Bahill  defined  decision  support  system  validation  as  “building  the  right  system: 
that  is  writing  specification  and  checking  performance  to  make  sure  that  the  system  does 
what  it  is  supposed  to  do”  (Bahill ).  Hayes-Roth  et  al.  suggested  four  evaluation 
principles: 

1 .  Complex  objects  or  processes  cannot  be  evaluated  by  a  single  criterion  or 
number. 

2.  The  larger  the  number  of  distinct  criteria  evaluated  or  measurements  taken, 
the  more  information  will  be  available  on  which  to  base  an  overall  evaluation. 

3.  People  will  disagree  about  the  relative  significance  of  various  criteria 
according  to  their  respective  interests. 

4.  Anything  can  be  measured  experimentally  as  long  as  exactly  how  to  take  the 
measurements  is  defined.  (Hayes-Roth,  Waterman  and  Lenat ) 

While  testing,  verification  and  some  validation  techniques  are  appropriate,  Hayes- 

Roth  et  al.  explained  that  blind  comparison  test  between  decision  support  tool  outputs  and 

other  expert  results  are  not  typically  appropriate. 

The  most  frequently  discussed  validation  technique  is  evaluation  by  peers. 

Whether  the  peer  expert  evaluators  were  involved  with  system  development  is  the  biggest 

validation  methodology  decision.  While  any  expert  can  validate  the  knowledge  within  a 

decision  support  system,  outside  experts  can  also  help  validate  whether  the  system 
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answers  the  right  problems  (Hayes-Roth,  Waterman  and  Lenat ).  Hayes-Roth  finally 
suggested  that  “the  true  goal  of  evaluation  should  not  be  to  show  how  well  a  system  does 
what  it  was  designed  to  do  but,  rather,  to  gain  a  greater  appreciation  of  the  process, 
structure,  and  limits  of  expertise.” 

According  to  Ayel,  decision  support  tool  validation  is  most  frequently  performed 
by  the  same  experts  used  to  define  the  original  system  (Ayel  and  Laurent ).  The  results 
of  his  research  are  shown  in  Table  15. 


Percentage 

Job  Category 

29.6 

Same  expert  from  whom  knowledge  was  gathered 

Knowledge  engineer 

maam 

Different  expert  than  from  whom  the  knowledge  was  gathered 

12.4 

End  user 

9.5 

“Sponsor”  of  the  project 

7.5 

Independent  validator 

0.3 

“Other” 

Table  15:  Typical  Sources  of  Decision  Support  Tool  Validators 


In  addition,  Ayel’s  study  shows  that  testing  a  decision  support  tool  versus  actual 
data  represents  the  most  prevalent  validation  effort  and  is  also  the  most  effective 
technique.  The  second  most  effective  and  common  validation  practice  is  to  test  the 
system  with  contrived  data  (Ayel  and  Laurent ).  Both  of  these  approaches  were  part  of 
the  validation  effort  for  this  research. 

Payne  states  that  specific  test  cases  should  be  developed  and  presented  to  both  the 
prototype  decision  support  tool  and  validation  experts.  Upon  completion,  the  “correct” 
expert  answers  must  be  compared  to  the  results  of  the  decision  support  tool.  Where 
substantial  differences  exist  between  the  answers,  developers  should  consider  entering 
new  rules  to  the  knowledge  base  (Payne  and  McArthur ). 
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Adelmen  identified  structural  and  behavioral  comparisons  for  decision  support 
tool  validation.  Structural  comparisons  focus  on  evaluating  the  similarities  in  how 
knowledge  base  and  the  non-design  subject  matter  experts  conceptualize  and  structurally 
represent  knowledge.”  Behavioral  comparisons  “focus  on  evaluating  the  similarity  and 
accuracy  of  the  predictions  made  by  the  knowledge  base  and  non-design  subject  matter 
experts  for  test  cases.”  (Adelman  and  Riedel ) 

These  structural  comparisons  are  typically  performed  by  a  decision  support  tool 
developer  (design  subject  matter  experts)  while  behavioral  comparisons  are  performed  by 
domain  experts  who  may  or  may  not  have  been  involved  in  the  knowledge  base  creation. 
Adelmen  suggests  three  to  five  validation  experts  as  ideal  for  decision  support  tool 
validation  and  points  out  that  one  or  two  validation  experts  can  be  used  if  the  test  cases 
are  well-crafted  to  cover  the  system  requirements  (Adelman  and  Riedel ). 

Parsaye  points  out  that  “some  of  the  techniques  for  verifying  and  validating 
simulation  models  are  also  useful  in  testing  and  simulating  the  operation  of  an  expert 
system.”  (Parsaye  and  Chignell )  This  parallel  between  decision  support  tool  and 
simulation  model  validation  means  that  previous  validations  of  simulations  and  decision 
support  tools  such  as  systems  dynamic  modeling  by  Tvedt,  Rus,  and  Ma  are  comparable 
to  this  validation  effort  (Ma  ;  Tvedt ;  Rus  ).  These  researchers  used  two,  four,  and  four 
validation  experts  -  falling  within  the  range  recommended  by  Adelman. 

In  some  domains  with  a  small  number  of  clearly  world-class  experts,  identifying 
experts  for  knowledge  acquisition  and  system  validation  can  be  simple  (Payne  and 
McArthur ).  However  in  many  fields,  experts  do  not  exist  with  experience  in  all  required 
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areas.  Software  development  with  its  many  domains  and  sub  domains  is  one  such  area. 
Experts  are  distinguished  by  their  procedural  knowledge  -  finding  and  fixing  problems. 
This  knowledge  can  be  deeply  theoretical  or  practical,  hands-on  experience  (Payne  and 
McArthur ). 

6.2  Validation  Methodology 

The  final,  important  step  to  complete  the  research  effort  was  to  ensure  the  model 
correctly  captures  outsourcing  experience  and  recommends  appropriate  outsourcing 
strategies  given  project  constraints. 

6.2.1  Performance  Validation  -  Expert  Consensus 

After  completion  of  the  model  and  decision  support  system,  experts  were  asked  to 
validate  the  model’s  structure,  rules,  and  appropriateness  of  outsourcing  strategy 
suggestions  for  various  project  scenarios.  Any  changes  were  used  to  further  refine  the 
model  and  decision  support  tool.  Experts  were  defined  as  software  project  managers  with 
at  least  five  years  of  outsourcing  experience  encompassing  at  least  1 0  development 
projects.  Outsourcing  consultants  and  authors  were  also  asked  to  review  the  tool  and 
framework. 

Experts  should  generally  agree  on  results  of  test  scenarios.  A  consensus  and  close 
agreement  with  the  decision  support  tool  indicates  a  successful  performance  validation. 
Comments  and  differences  were  reviewed  to  produce  new  candidate  rules  or 
change/eliminate  existing  rules.  Twelve  experienced  software  development  outsourcers 
were  selected  to  determine  consensus  for  test  scenarios. 
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Experts  were  asked  to  review  four  evaluation  test  scenarios  to  cover  each  major 
software  domain.  Product  and  process  outsourcing  were  varied  to  cover  the  maximum 
number  of  existing  rules  with  emphasis  on  the  most  prevalent  outsourcing  strategies. 
These  same  scenarios  were  used  for  both  the  expert  consensus  and  usefulness  evaluation. 

6.2.2  Usefulness  Evaluation 

Novices  were  asked  to  predict  outsourcing  consequence  for  the  same  evaluation 
scenarios  as  the  experts.  Comparison  of  the  novice  results  to  experts’  results  and  tool 
outputs  showed  that  the  knowledge  base  rules  are  not  simply  intuitive  as  evidenced  by  a 
lack  of  strong  consensus  among  the  novice  predictions  and  lower  level  of  success 
matching  the  novice  predictions  and  tool  outputs.  Twelve  inexperienced  software 
development  outsourcers  were  selected,  each  with  experience  on  no  more  than  one 
outsourcing  software  development  project. 

6.3  Validation  Results 

6.3.1  Scenario  Selection  and  Rule  Coverage 

Four  contrived  outsourcing  scenarios  were  developed  for  both  the  performance 
and  usefulness  evaluations.  The  scenarios  were  developed  to  achieve  the  most  complete 
coverage  of  domains,  processes,  and  outsourcing  product  types  in  balance  with  a  need  to 
not  overwhelm  validation  respondents.  The  scenarios  can  be  found  within  the  validation 
package  included  as  Appendix  F.  Together,  the  scenarios  exercise  25  different  rules  from 
the  total  of  30  outsourcing  decision  support  rules  found  during  this  research  effort.  Since 
each  scenario  involves  outsourcing,  all  used  the  outsourcing  constants  found  in  decision 
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rule  number  16.  Rules  19  and  25  were  each  used  twice,  while  rules  four,  five,  11,  12,  and 
15  were  not  used  in  any  of  the  scenarios.  A  complete  list  of  outsourcing  rules  can  be 
found  in  Appendix  E. 

6.3.2  Performance  Validation  -  Expert  Consensus 

Six  experts  reviewed  four  outsourcing  scenarios  and  estimated  the  consequences 
of  each  scenario  based  upon  the  same  inputs  required  by  the  decision  support  tool.  In 
several  cases,  experts  assumed  additional  facts  about  the  scenario  that  could  cause 
confusion.  This  researcher  was  able  to  eliminate  this  confusion  by  using  the  assertion 
rules  from  the  outsourcing  tool  to  account  for  changes  in  specific  consequences  related  to 
the  expert’s  assumptions.  Tool  outputs,  expert  responses,  and  comparison  data  can  be 
found  in  Appendix  G. 

The  expert  estimates  were  compared  directly  with  the  decision  support  tool 
outputs  for  each  scenario.  Each  tool  output  is  a  specific  number  that  fits  in  the 
continuous  range  from  one  to  seven.  The  experts  responded  using  the  same  scale  from 
the  original  survey  and  is  shown  in  Figure  67.  To  account  for  the  larger  granularity  of  the 
survey  response  scale,  each  tool  output  was  given  a  plus  or  minus  range  of  one  and  then 
compared  to  the  experts  responses.  A  response  was  considered  a  match  if  it  fell  within 
the  range  of  the  tool  output.  Experts  matched  73  percent  of  the  tool  outputs  across  the 
four  validation  scenarios.  The  expert  success  was  consistent  across  all  projects  with  no 
averages  below  70  percent.  The  results  for  this  validation  analysis  are  shown  in  Table 


16. 
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Much  like  the  overall  averages,  each  expert  was  consistent  in  their  success  in 
matching  the  tool  outputs.  No  expert  average  fell  below  68  percent.  A  second  analysis 
compared  the  tool  outputs  and  expert  responses  on  the  basis  of  whether  the  responses 
predicted  the  consequence  in  the  same  direction.  This  criterion  is  can  be  defined  by 
example.  If  the  tool  predicts  an  increase  for  a  consequence,  an  expert  response  is  a  match 
if  it  also  predicts  and  improvement.  When  this  looser  criterion  is  applied,  expert  success 
in  matching  the  tool  outputs  increased  to  85  percent  as  shown  in  Table  17. 

With  a  Delta  Range  of  1  on  7  Point  Scale 
Scenario  1  Scenario  2  Scenario  3  Scenario  4  Average 

Expert  70%  78%  74%  71%  73% 

Novice _ 48% _ 52% _ 43% _ 45% _ 47% 

Difference  22%  26%  32%  26%  27% 

Table  16:  Validation  Consensus  by  Range 

Matching  Sign  (Improve/Degrade/Neutral) 

Scenario  1  Scenario  2  Scenario  3  Scenario  4  Average 

Expert  83%  87%  86%  85%  85% 

Novice _ 63% _ 66% _ 58% _ 71% _ 65% 

Difference  20%  21%  29%  14%  21% 

Table  17:Validation  Consensus  by  Direction 


6.3.3  Usefulness  Evaluation 

Seven  novice  software  outsourcing  professionals  were  asked  to  complete  the  same 
four  scenarios  as  the  six  experts  described  in  Section  6.3.2  above.  Table  16  shows  the 
results  of  the  range-based  comparison  between  novice  and  expert  responses  and  the 
decision  support  tool  outputs.  Table  17  shows  the  same  analysis  with  the  looser  criterion 
of  matching  direction  between  expert  and  novice  responses  and  the  decision  support  tool 


outputs. 
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The  tool  can  be  considered  useful  since  the  tool  outputs  match  the  expert 
responses  significantly  better  than  novice  responses.  This  result  implies  the  decision 
support  tool  and  its  knowledge  base  rules  are  not  simply  intuitive  information.  To 
conclusively  demonstrate  significance,  the  success  rates  for  every  completed  scenario 
were  divided  into  those  performed  by  experts  and  those  from  novices.  Since  the  overall 
average  for  the  novice  validators  was  47  percent,  each  set  was  compared  to  50  percent. 
The  results  of  these  one-sample  T-tests  are  shown  in  and  described  in  section  4.8.  Using 
the  same  Bonferroni  correction,  the  novice  responses  were  not  significantly  different 
from  the  0.5  (50  percent)  value  while  the  expert  values  were  significantly  different 
beyond  the  95  percent  confidence  level. 


Test  Value  =  0.5 

t 

df 

Sig.  (2-tailed) 

Mean  Difference 

EXPERT 

12.61027 

18 

2.26E-10 

0.237895 

NOVICE 

-0.89424 

13 

0.387452 

-0.03429 

Table  18:  Comparison  of  Novice  and  Expert  Success  Rates 


6.3.4  Expert  Review 

Three  experts  agreed  to  review  the  internal  rules  and  assertions  that  comprise  the 
decision  support  tool.  Only  Mr.  Mike  Epner  completed  the  review,  comparing  the  rule 
base  structure  and  with  his  experiences.  He  is  a  Process  Improvement  Director  with 
TeraQuest  Metrics,  Inc.,  providers  of  strategic  consulting,  assessments,  and  training  for 
organizations  that  build  or  acquire  software  intensive  systems.  Mr.  Epner  specializes  in 
software  acquisition  management,  assisting  Fortune  500  companies  as  well  as  emerging 
companies  with  their  outsourcing  practices.  His  projects  have  spanned  diverse  industries 
including  medical,  telecommunication,  e-commerce,  and  transportation,  and  have 
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involved  multi-billion  dollar  outsourcing  agreements.  Prior  to  joining  TeraQuest,  he  was 
Director  of  Quality  Services  at  Eastman  Kodak  Company  where  he  led  the  quality 
assurance,  test,  configuration  management  and  systems  integration  activities  for  two 
medical  software  divisions.  His  responsibilities  included  the  specification  and  integration 
of  outsourced  software  systems  for  enterprise  telemedicine  configurations.  Mr.  Epner  has 
authored  articles  on  software  process  improvement  for  Cutter  IT  Journal,  Quality 
Observer  and  Medical  Software  Weekly.  He  recently  completed  a  2-year  term  as 
Regional  Councilor  for  the  American  Society  for  Quality's  Software  Division. 

Mr.  Epner’ s  validation  review  summary  is  presented  in  Table  19  below. 


Mike  Epner  Review 

Consequence 

Agreement 

Comments 

1 .  Administrative  Overhead  - 
Rules 

Yes 

Administrative  Overhead  - 
Assertions 

Yes 

2.  Control  Over  Final  Product  - 
Rules 

Yes 

Control  Over  Final  Product  - 
Assertions 

Yes 

3.  Control  Over  Outsourced 
Project  Management  Process 
-  Rules 

Not  Sure 

I  don't  see  why  custom  vs. 
customized  common  implies  less 
control.  Perhaps  it's  more  than 
management  processes  but  business 
processes  that  are  being  considered 
by  those  surveyed?  Buyers  are 
often  forced  to  use  business 
processes  based  on  the  customized 
app  vs.  defining  the  app  to  meet 
business  need  in  the  custom  case.  I 
am  OK  with  the  other  rules. 

Control  Over  Outsourced 
Project  Management  Process 
-  Assertions 

Yes 

Makes  sense.  I  find  it  interesting 
that  payment  strategies  and 
incentives  are  not  a  factor  in  control 
as  that  is  often  the  motivation  for 
employing  them. 
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Mike  Epner  Review 

Consequence 

ERfWS  !'"fl  if i  is  ^Hsl 

Comments 

4.  Costs  Associated  with 

Changes  -  Rules 

Yes 

Costs  Associated  with 

Changes  -  Assertions 

Yes 

Very  much  so.  The  vendor  is  likely 
squeezed  already  in  situations 
where  there  are  cost  schedule 
pressures.  Changes  essentially 
'open  the  valve.' 

5.  Cultural,  Location,  and 
Language  Problems  -  Rules 

Yes 

Cultural,  Location,  and 
Language  Problems  - 
Assertions 

Yes 

6.  Development  Risks  -  Rules 

Yes 

Development  Risks  - 
Assertions 

Yes 

I  would  have  expected  maturity  of 
the  vendor  to  reduce  risk 

7.  Development  Schedule 
Duration  -  Rules 

No 

I'm  not  sure  what  we  are  comparing 
here.  Clearly,  if  I  outsource  and  use 
a  COTS  solution  (or  even 
customized  COTS),  it  SHOULD 
result  in  reduced  development  time 
vs.  starting  from  scratch.  That  is 
often  a  motivation  for  engaging  a 
vendor  as  you  state.  If  we  are 
comparing  COTS  implemented 
with  a  vendor  vs.  internally,  then 
there  probably  is  no  significant 
reduction  and  the  conclusion  holds, 
though  it's  not  particularly  useful. 

Development  Schedule 
Duration  -  Assertions 

Yes 

8.  In-House  Effort  Spent  on 
Non-Core  Activities  -  Rules 

Yes 

In-House  Effort  Spent  on 
Non-Core  Activities  - 
Assertions 

Yes 

9.  In-House  Personnel  Turnover 
-  Rules 

Yes 
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Mike  Epner  Review 

Consequence 

Agreement 

Comments 

In-House  Personnel  Turnover 
-  Assertions 

Yes 

I  would  expect  the  level/rate  of 
outsourcing  to  play  a  factor.  If  a 
large  percentage  of  new  projects  are 
outsourced,  in-house  turnover  will 
likely  increase.  Also,  if 
management  does  not  communicate 
how  the  organization  is  evolving 
and  provide  technical  growth  paths 
(ie,  non-maintenance  focused 
opportunities),  turnover  will 
increase. 

10.  Intellectual  Capital  -  Rules 

Yes 

This  finding  is  consistent  with  my 
experience  and  I  agree  that  it  is 
surprising.  In  many  cases,  buyers 
have  negotiated  all  rights,  in  others; 
they  don't  realize  the  impact  of  the 
rights  that  they  have  given  up  until 
later. 

Intellectual  Capital  - 
Assertions 

Not  Sure 

I  have  seen  buyers  relinquish  rights 
for  pricing/cost  concessions. 

1 1 .  Likelihood  of  Failed  or 
Cancelled  Project  -  Rules 

Yes 

Likelihood  of  Failed  or 
Cancelled  Project  - 
Assertions 

Not  Sure 

Decreased  likelihood  of  failure  if 
far  apart  is  certainly  not  intuitive. 
This  directly  contradicts  1 .5  and 

1.16  to  some  degree.  Distance  does 
usually  drive  better  requirements  so 
it  could  be  that  that  compensates  for 
the  other  inherent  risks/problems. 

12.  Product  Quality  -  Rules 

Yes 

Product  Quality  -  Assertions 

Yes 

No  impact  of  CMM  level  on 
quality?  Interesting. 

13.  Project  Costs  -  Rules 

Yes 

Project  Costs  -  Assertions 

Yes 
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Mike  Epner  Revi 

ew 

Consequence 

Agreement 

Comments 

14.  Project  Learning  Curve  - 
Rules 

No 

I'm  confused  by  this,  many 
organizations  outsource  because 
they  lack  the  skills  and  cannot 
afford  the  learning  curve. 

Outsourcing  supplants  the  learning 
curve  with  personnel  skilled  in  the 
project  area  and  shortens  the 
learning  curve  by  virtue  of  its 
instantiation  in  any  of  the 
product/domain  areas. 

Project  Learning  Curve  - 
Assertions 

Yes 

15.  Responsiveness  to  Customer 
Objectives  -  Rules 

Yes 

Responsiveness  to  Customer 
Objectives  -  Assertions 

Yes 

16.  Responsiveness  to 

Organizational  Objectives  - 
Rules 

Yes 

Responsiveness  to 
Organizational  Objectives  - 
Assertions 

Yes 

Yep,  as  buyers  increase  the  pressure 
on  cost  and  schedule,  vendors 
cannot  fit  changes  and  'other' 
activities  not  originally  considered. 
Results  in  perceived  lack  of 
responsiveness. 

17.  Rework  -  Rules 

Yes 

Rework  -  Assertions 

Yes 

18.  Schedule  Flexibility  -  Rules 

Not  Sure 

I  don't  see  an  obvious  reason  why 
this  domain  is  different  from  the 
others. 

Schedule  Flexibility  - 
Assertions 

Yes 

19.  Turf  Wars  -  Rules 

Yes 

Turf  Wars  -  Assertions 

Yes 

20.  Visibility  into  the  Software 
Development  Process  - 
Rules 

Yes 

Visibility  into  the  Software 
Development  Process  - 
Assertions 

Yes 

Table  19:  Mike  Epner  Validation  Review  Summary 
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Mr.  Epner  disagreed  with  only  two  of  the  twenty  rules.  The  first  disagreement 
concerns  the  development  schedule  duration  consequence.  He  presents  a  well-taken 
argument  that  COTS  outsourcing  should  correspond  to  reduced  schedule  duration.  This 
relationship  between  COTS  outsourcing  and  schedule  duration  was  a  research  hypothesis 
prior  to  the  survey,  but  not  borne  out  by  the  statistical  analysis.  The  second  disagreement 
concerned  project  learning  curve.  Mr.  Epner  points  out  that  a  great  deal  of  outsourcing  is 
undertaken  to  acquire  expertise  not  available  in-house,  but  did  not  mention  that  for  some 
projects  in-house  personnel  shortages  drive  the  outsourcing  decision.  In  these  cases,  we 
might  expect  in-house  personnel  to  have  more  domain  expertise  than  vendor  personnel  - 
thus  increasing  the  learning  curve.  Mr.  Epner  did  not,  however,  disagree  with  the  notion 
that  Order  Entry  Systems  might  correspond  with  reduced  project  learning  curves.  Mr. 


Epner’ s  comments  in  the  review  suggest  several  new  assertions  to  add  to  the  decision 
support  tool  (Table  20). 


Factor 

Consequence 

Vendor  Maturity 

Development  Risks  (IMP) 

COTS  Product  Outsourcing 

Development  Schedule  (IMP) 

Level  of  Outsourcing 

In-House  Personnel  Turnover  (WOR) 

Table  20:  Suggested  Additional  Assertions 


Overall  this  quality  review  validated  the  rules  and  assertions  built  into  the 
decision  support  tool.  The  statistically  arrived-upon  rules  are  understandable  and  match 
this  expert’s  experience.  Based  upon  his  recommendations,  the  three  new  assertions  were 
added  to  the  tool  and  Appendix  D. 
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6.4  Validation  Summary 

The  validation  effort  was  successful  by  all  measures.  Expert  responses  closely 
matched  tool  outputs  indicating  quality  performance.  Novice  responses  failed  to  match 
expert  performance  indicating  the  knowledge  base  contains  rules  that  are  not  simply 
intuitive.  Finally,  expert  review  of  the  rule  structure  indicated  strong  agreement  with  the 
rules  demonstrating  they  are  understandable  and  match  reviewer  experience  where 
applicable.  Given  this  successful  validation,  Chapter  7  summarizes  the  conclusions  that 
can  be  made  from  this  research  effort,  contributions  the  research  makes  to  understanding 
software  outsourcing,  and  several  future  directions  which  can  further  build  upon  this 
research. 


7.  Conclusions,  Contributions,  and  Future  Work 


7.1  Conclusions 

This  research  effort  stemmed  from  a  need  to  better  understand  why  and  how 
outsourcing  is  currently  being  used  in  software  development  and  finding  ways  to  improve 
a  manager’s  abilities  to  select  appropriate  outsourcing  courses-of-action.  Chapter  2 
presented  the  concepts  of  an  outsourcing  strategy  and  previously  published  outsourcing 
literature.  Since  this  literature  fails  to  meet  the  research  goals,  a  plan  for  meeting  the 
goals  was  presented  in  Chapter  3.  The  survey  methodology,  statistical  analysis,  decision 
support  tool  development,  and  validation  effort  established  credibility  for  the  research 
methodology  and  results.  Chapter  4  presented  the  results  of  the  outsourcing  survey  and 
statistical  analysis.  In  addition  to  producing  decision  support  rules,  outsourcing  goals  and 
demographics  expand  the  largely  anecdotal  nature  of  previous  software  development 
literature.  The  prototype  decision  support  tool  rules,  implementation,  and  usage  are 
shown  in  Chapter  5.  Finally,  extensive  validation  results  demonstrate  the  impressive 
performance  of  the  outsourcing  rules  and  framework  (Chapter  6). 

7.2  Contributions 

7.2.1  Outsourcing  Demographics 

The  research  results  presented  information  about  how  much  software 
development  outsourcing  is  occurring  and  who  within  software  development 
organizations  make  outsourcing  decisions.  While  this  information  cannot  be  assumed  to 
generalize  beyond  the  sample  population,  its  breadth  is  considerably  larger  than  that  of 
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most  individuals.  The  context  of  a  broad  survey  covering  all  major  software 
development  domains  differentiates  this  study  from  most  software  outsourcing  literature 
that  is  typically  the  result  of  an  individual  author’s  consulting  experience.  While  the 
smaller  individual-level  picture  is  valid  and  helpful  to  a  consultant’s  clients,  a  broader 
study  of  the  software  domain  provides  a  better  basis  for  developing  a  software 
outsourcing  framework. 

7.2.2  Outsourcing  Strategies 

A  primary  goal  of  this  research  was  to  determine  how  software  domains, 
outsourced  processes,  and  product  types  affect  software  outsourcing  project 
consequences.  These  three  factors  define  a  software  outsourcing  strategy  as  discussed  in 
Chapters  2  and  3.  No  other  published  work  discusses  types  of  outsourcing  strategies  at 
the  project  level  -  selecting  which  process  and  product  components  to  outsource  for  a 
specific  project.  Finally,  this  study  expanded  all  previous  software  outsourcing  literature 
that  focused  on  a  single  software  domain  or  a  few  related  software  domains. 

7.2.3  Outsourcing  Goals 

Most  authors  and  practitioners  assumed  that  outsourcing  of  software  development 
occurs  primarily  to  reduce  costs,  reduces  schedule  durations,  or  to  offload  development 
effort  due  to  in-house  personnel  shortages.  This  study  identified  fourteen  significant 
outsourcing  goals  and  showed  that  many  of  these  goals  are  more  significant  than  the  three 
frequently  published  goals. 
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7.2.4  Outsourcing  Framework 

The  central  goal  of  this  research  effort  was  to  determine  how  software  domains, 
process  components  outsourced,  and  product  component  types  outsourced  affect  the 
outcomes  of  software  development  outsourcing  projects.  The  statistical  analysis  of 
survey  responses  yielded  30  significant  rules  that  define  how  these  factors  affect 
outsourcing  projects.  This  work  is  new  in  terms  of  content  and  unusual  in  its  technique 
for  capturing  knowledge.  Most  knowledge  base  data  collected  for  decision  support  tools 
is  collected  from  a  single  expert.  Many  software  researchers  collect  survey  data  to 
develop  expert  systems,  but  few  use  statistical  techniques  to  distill  the  information. 

Most,  manually  collate  data  to  find  patterns  -  a  technique  prone  to  researcher  bias  and 
error.  This  analysis  used  statistical  regression  and  sampling  techniques  to  discover  the 
software  outsourcing  rules.  The  ability  to  easily  explain  these  statistically  discovered 
rules  lends  additional  credibility  to  this  work. 

7.2.5  Decision  Support  Tool 

The  prototype  decision  support  tool  should  be  interesting  to  software  development 
managers,  consultants,  management  academics,  and  software  engineering  academics. 

The  fully-populated  and  validated  tool  can  be  used  in  industry,  expanded  for  new 
strategies  and  additional  scenarios,  used  as  a  front-end  for  a  modeling  analysis  of 
outsourcing,  and  studied  as  a  method  for  making  other  software  management  decisions. 
This  research  effort  has  generated  interested  from  academic,  industrial,  and  government 
practitioners. 
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7.3  Future  Work 

7.3.1  Software  Outsourcing  Modeling 

As  previously  mentioned,  Steve  Roehling,  a  Master’s  student  at  Arizona  State 

University,  has  developed  the  first  systems  dynamics  modeling  simulation  of  an 
outsourcing  relationship.  The  decision  rules  from  this  knowledge  base  are  factors  that 
affect  the  consequences  of  outsourcing  projects.  These  rules  can  become  inputs  to  future 
simulation  models  to  expand  the  ability  to  study  additional  consequences  and  strategies. 

7.3.2  Expand  Outsourcing  Rules  and  Assertions 

While  the  decision  support  rules  are  an  important  first  step,  this  researcher 
realizes  they  are  not  necessarily  complete.  In  some  cases,  the  regression  models  in 
Appendix  A  explain  less  than  50  percent  of  the  variance  for  specific  outsourcing 
consequences.  Other  factors  such  as  those  studied  in  the  ‘assertions’  section  of  the 
survey  should  be  quantified  and  added  to  the  overall  model.  This  expansion  will  take 
anecdotal  evidence  from  the  literature  and  the  qualitative  survey  assertions  from  this 
study  and  develop  new  and  additional  rules  that  explain  more  completely  the 
consequences  of  specific  outsourcing  projects.  While  this  research  effort  studied  projects 
in  nearly  all  software  development  domains,  some  information  such  as  the  bureaucratic 
nature  of  software  projects  (military,  government,  or  commercial  applications)  and 
geographical  factors  were  not  specifically  captured  or  analyzed. 
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7.3.3  Automate  Knowledge  Base  Creation  and  Updating 

As  mentioned  in  Section  5.5,  several  knowledge  base  creation  environments  are 
available.  These  systems  allow  decision  tool  developers  to  easily  change  rules  based  on 
new  research  and  encapsulate  rule  implementation  from  tool  functionality.  While  this 
study  was  intended  to  prototype  the  tool  concept,  and  most  importantly  baseline  the 
outsourcing  decision  rule  data,  future  development  should  focus  on  tool  robustness, 
modularity,  and  expandability. 
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Appendix  A:  Regression  for  Outsourcing  Consequences 


Regression 

Warnings 

For  models  with  dependent  variable 
consequence_admin_overhead,  the 
following  variables  are  constants  or 
have  missing  correlations: 
shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 
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Variables 

Variables 

Model 

Entered 

Removed 

Method 

i 

whatproce 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

ss-docum 

entation 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

2 

enterprise- 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

manufact 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

3 

shrink-utilit 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

ies 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

a.  Dependent  Variable:  consequence_admin_overhead 
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Model  Summary 
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d.  Dependent  Variable:  consequence_admin_overhead 
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Coefficients’ 
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a.  Dependent  Variable:  consequence_admin_overhead 
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Regression 

Warnings 

For  models  with  dependent  variable 
consequence_change_costs,  the 
following  variables  are  constants  or 
have  missing  correlations: 
shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 
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Coefficients? 
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Regression 

Warnings 

For  models  with  dependent  variable 
consequence_control_process,  the 
following  variables  are  constants  or 
have  missing  correlations: 
shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 
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eering 

Probabilit 

COMPONE 

y-of-F-to-r 
emove  >= 
.100). 
Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

NT 

.050, 

whatprodu 

Probabilit 
y-of-F-to-r 
emove  >= 
.100). 
Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

cts-commo 

.050, 

n-cust 

Probabilit 

y-of-F-to-r 
emove  >= 
.100). 

1 


a-  Dependent  Variable:  consequence_control_process 
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Model  Summary 


Model 

R 

R  Square 

Adjusted 
R  Square 

Std.  Error 
of  the 
Estimate 

Chanqe  Statistics 

R  Square 
Chanqe 

F  Change 

dfl 

df2 

Sig.  F 
Chanqe 

1 

,326a 

.106 

.095 

■BB1 

1 

78 

.003 

m 

.455b 

.207 

.186 

IB 

n 

77 

.002 

|p* 

.514° 

.264 

.235 

na 

76 

.018 

,557d 

.310 

.274 

1.2935 

5.068 

1 

75 

.027 

a- Predictors:  (Constant),  whatprocess-design 

b.  Predictors:  (Constant),  whatprocess-design,  whatprocess-reengineering 

c.  Predictors:  (Constant),  whatprocess-design,  whatprocess-reengineering,  COMPONENT 

d.  Predictors:  (Constant),  whatprocess-design,  whatprocess-reengineering,  COMPONENT,  whatpr 


ANOVA® 


Model 

df 

Mean 

Square 

F 

Sig. 

1 

Regression 

19.337 

1 

19.337 

.003a 

Residual 

162.651 

78 

2.085 

Total 

181.987 

79 

2 

Regression 

37.679 

2 

18.839 

10.052 

,000b 

Residual 

144.309 

77 

1.874 

Total 

181.987 

79 

3 

Regression 

48.016 

3 

16.005 

9.080 

,000c 

Residual 

133.972 

76 

1.763 

Total 

181.987 

79 

4 

Regression 

56.496 

4 

14.124 

8.441 

,000d 

Residual 

125.491 

75 

1.673 

Total 

181.987 

79 

a.  Predictors:  (Constant),  whatprocess-design 

b.  Predictors:  (Constant),  whatprocess-design,  whatprocess-reengineering 

c.  Predictors:  (Constant),  whatprocess-design,  whatprocess-reengineering, 
COMPONENT 

d.  Predictors:  (Constant),  whatprocess-design,  whatprocess-reengineering, 
COMPONENT,  whatproducts-common-cust 

e.  Dependent  Variable:  consequence_control_process 
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Coefficients? 


Unstandardized 

Coefficients 

Standardi 

zed 

Coefficien 

ts 

Model 

B 

Std.  Error 

Beta 

t 

Siq. 

1 

(Constant) 

4.368 

.331 

13.186 

.000 

whatprocess-design 

-1.155 

.379 

-.326 

-3.045 

.003 

2 

(Constant) 

4.169 

.320 

13.011 

.000 

whatprocess-design 

whatprocess-reengi 

-1.184 

.360 

-.334 

-3.290 

.002 

neering 

1.261 

.403 

.318 

3.128 

b 

o 

3 

(Constant) 

4.556 

.349 

13.038 

.000 

whatprocess-design 

whatprocess-reengi 

-1.367 

.357 

-.386 

-3.829 

.000 

neering 

1.407 

.395 

.355 

3.559 

.001 

COMPONENT 

-.779 

.322 

-.246 

-2.422 

.018 

4 

(Constant) 

4.829 

.361 

13.364 

.000 

whatprocess-design 

whatprocess-reengi 

-1.465 

.351 

-.413 

-4.178 

.000 

neering 

1.336 

.387 

.337 

3.455 

.001 

COMPONENT 

whatproducts-comm 

-.802 

.314 

-.254 

-2.557 

.013 

on-cust 

-.789 

.350 

-.218 

-2.251 

.027 

a-  Dependent  Variable:  consequence_control_process 
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Regression 

Warnings 

For  models  with  dependent  variable 
consequence_control_product,  the 
following  variables  are  constants  or 
have  missing  correlations: 
shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 


Variables  Entered/Removecf 


Variables 

Variables 

Model 

Entered 

Removed 

Method 

i 

whatprodu 

cts-commo 

n-cust 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

2 

whatproce 

ss-mainte 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 

nance 

Probabilit 

y-of-F-to-r 

emove  >= 

.100). 

a-  Dependent  Variable:  consequence_control_product 


Model  Summary 


Std.  Error 

Change  Statistics 

Model 

R 

R  Square 

Adjusted 
R  Square 

of  the 
Estimate 

R  Square 
Change 

F  Change 

dfl 

df2 

Sig.  F 
Chanqe 

1 

,307a 

.094 

.083 

1.2493 

.094 

8.105 

1 

78 

.006 

2 

.383b 

.146 

.124 

1.2205 

4.722 

1 

77 

.033 

a- Predictors:  (Constant),  whatproducts-common-cust 


Predictors:  (Constant),  whatproducts-common-cust,  whatprocess-maintenance 
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ANOVAc 


Model 

Sum  of 
Squares 

df 

Mean 

Square 

F 

Sig. 

1 

Regression 

12.650 

1 

12.650 

8.105 

.006a 

Residual 

121.738 

78 

1.561 

Total 

134.388 

79 

2 

Regression 

19.684 

2 

9.842 

6.607 

,002b 

Residual 

114.704 

77 

1.490 

Total 

134.388 

79 

a-  Predictors:  (Constant),  whatproducts-common-cust 

b-  Predictors:  (Constant),  whatproducts-common-cust,  whatprocess-maintenance 
c-  Dependent  Variable:  consequence_control_product 


Coefficients? 


Standard! 

zed 

Unstandardized 

Coefficien 

Coefficients 

ts 

Model 

B 

Std.  Error 

Beta 

t 

Siq. 

1 

(Constant) 

3.934 

.160 

24.597 

.000 

whatproducts- 

common-cust 

-.934 

.328 

-.307 

-2.847 

.006 

2 

(Constant) 

3.722 

.184 

20.179 

.000 

whatproducts- 

common-cust 

-1.080 

.328 

-.354 

-3.296 

.001 

whatprocess- 

maintenance 

.618 

.285 

.234 

2.173 

.033 

a-  Dependent  Variable:  consequence_control_product 
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Regression 

Warnings 

For  models  with  dependent  variable 
consequence_costs,  the  following 
variables  are  constants  or  have 
missing  correlations: 
shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 


Variables  Entered/Removecf 


Variables 

Variables 

Model 

Entered 

Removed 

Method 

1 

component 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

-CASE 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

2 

whatprodu 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

cts-custom 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

3 

enterprise- 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

manufact 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

a  Dependent  Variable:  consequence_costs 
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Model  Summary 


Model 

R 

Adjusted 
R  Square 

Std.  Error 
of  the 
Estimate 

Change  Statistics 

R  Square 
Change 

F  Change 

dfl 

df2 

pB 

1 

.31 9a 

.102 

.090 

1.3834 

1 

79 

.004 

.433b 

.187 

.166 

1 

78 

.005 

.501c 

.251 

.222 

1.2795 

6.561 

1 

77 

.012 

a- Predictors:  (Constant),  component-CASE 

b-  Predictors:  (Constant),  component-CASE,  whatproducts-custom 

c- Predictors:  (Constant),  component-CASE,  whatproducts-custom,  enterprise-manufact 


ANOVAd 


Model 

Sum  of 
Squares 

df 

Mean 

Square 

F 

■■ 

1 

Regression 

17.142 

1 

,004a 

Residual 

151.179 

79 

Total 

168.321 

80 

2 

Regression 

31.529 

2 

mm m 

8.989 

,000b 

Residual 

136.792 

78 

Total 

168.321 

80 

3 

Regression 

42.270 

3 

8.607 

.000° 

Residual 

126.051 

77 

Total 

168.321 

80 

mm 

a  Predictors:  (Constant),  component-CASE 

b.  Predictors:  (Constant),  component-CASE,  whatproducts-custom 

c.  Predictors:  (Constant),  component-CASE,  whatproducts-custom, 
enterprise-manufact 

d.  Dependent  Variable:  consequence_costs 
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Coefficients' 


Model 

Unstandardized 

Coefficients 

Standardi 

zed 

Coefficien 

ts 

t 

Sig. 

B 

Std.  Error 

Beta 

1 

(Constant) 

4.436 

.157 

28.320 

.000 

component-CASE 

-2.436 

.814 

-.319 

-2.993 

.004 

2 

(Constant) 

3.792 

.270 

14.027 

.000 

component-CASE 

-2722 

.786 

-.357 

-3.465 

.001 

whatproducts-custom 

.931 

.325 

.295 

2.864 

.005 

3 

(Constant) 

3.652 

.267 

13.690 

.000 

component-CASE 

-2.722 

.759 

-.357 

-3.587 

.001 

whatproducts-custom 

1.070 

.319 

.339 

3.359 

.001 

enterprise-manufact 

3.348 

1.307 

.256 

2.561 

.012 

a  Dependent  Variable:  consequence_costs 
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Regression 

Warnings 

For  models  with  dependent  variable 
consequence_cult_locationJang_p, 
the  following  variables  are 
constants  or  have  missing 
correlations:  shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 


Variables  Entered/RemovecJ 


Variables 

Variables 

Model 

Entered 

Removed 

Method 

1 

shrink-utilit 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

ies 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

2 

COMPONE 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

NT 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

3 

systems-a 

Stepwise 

(Criteria: 

Probabilit 

y-of-F-to-e 

nter<= 

vionics 

.050, 

Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

a-  Dependent  Variable: 

consequence_cultJocationJang_p 
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Model  Summary 


Model 

R 

R  Square 

Adjusted 
R  Square 

Std.  Error 
of  the 
Estimate 

Change  Statistics 

R  Square 
Change 

F  Change 

dfl 

df2 

Pm 

mEBEIa 

1 

.315® 

.099 

.087 

.7503 

.099 

8.344 

1 

.005 

.425b 

.181 

.159 

.7203 

.082 

7.473 

1 

mS 

.008 

.484° 

.234 

.203 

.7011 

.053 

5.168 

1 

74 

.026 

a  Predictors:  (Constant),  shrink-utilities 

b.  Predictors:  (Constant),  shrink-utilities,  COMPONENT 

c- Predictors:  (Constant),  shrink-utilities,  COMPONENT,  systems-avionics 


ANOVAd 


Model 

df 

Mean 

Square 

LL 

fm 

1 

Regression 

4.698 

1 

4.698 

8.344 

.005a 

Residual 

42.789 

76 

.563 

Total 

47.487 

77 

2 

Regression 

8.575 

2 

8.264 

JQ 

T — 

o 

o 

Residual 

38.912 

75 

Total 

47.487 

77 

3 

Regression 

11.115 

7.538 

,000c 

Residual 

36.372 

Total 

47.487 

a.  Predictors:  (Constant),  shrink-utilities 

b.  Predictors:  (Constant),  shrink-utilities,  COMPONENT 

c.  Predictors:  (Constant),  shrink-utilities,  COMPONENT,  systems-avionics 

d.  Dependent  Variable:  consequence_cult_location_lang_p 


Appendix  A:  Regression  for  Outsourcing  Consequences 


138 


Coefficients? 


Model 

Unstandardized 

Coefficients 

Standardi 

zed 

Coefficien 

ts 

t 

Sig. 

B 

Std.  Error 

Beta 

i 

(Constant) 

4.447 

.086 

51.671 

.000 

shrink-utilities 

1.553 

.538 

.315 

2.889 

o 

o 

2 

(Constant) 

4.603 

.100 

45.857 

.000 

shrink-utilities 

1.634 

.517 

.331 

3.161 

.002 

COMPONENT 

-.474 

.173 

-.286 

-2.734 

.008 

3 

(Constant) 

4.573 

.099 

46.393 

.000 

shrink-utilities 

1.693 

.504 

.343 

3.361 

.001 

COMPONENT 

-.532 

.171 

-.322 

-3.119 

.003 

systems-avionics 

.746 

.328 

.234 

2.273 

.026 

a  Dependent  Variable:  consequence_cult_location_lang_p 
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Regression 

Warnings 

For  models  with  dependent  variable 
consequence_failure_likelihood,  the 
following  variables  are  constants  or 
have  missing  correlations: 
shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 


Variables  Entered/Removecf 


Model 

Variables 

Entered 

Variables 

Removed 

Method 

1 

2 

3 

whatproce 

ss-toolsup 

Pt 

whatproce 

ss-CM 

whatproce 

ss-SWEng 

Suppt 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 
Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 
Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 
.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

a  Dependent  Variable:  consequence_failure_likelihood 


Appendix  A:  Regression  for  Outsourcing  Consequences 


140 


Model  Summary 


Model 

R 

Adjusted 
R  Square 

Std.  Error 
of  the 
Estimate 

Chanqe  Statistics 

R  Square 
Change 

F  Change 

dfl 

df2 

pH 

1 

.294® 

.087 

1.3377 

.087 

7.301 

1 

D 

.008 

,429b 

.184 

Hi 

.097 

1 

.004 

.475° 

.225 

.041 

4.006 

1 

Hi 

.049 

a- Predictors:  (Constant),  whatprocess-toolsuppt 

b- Predictors:  (Constant),  whatprocess-toolsuppt,  whatprocess-CM 

c-  Predictors:  (Constant),  whatprocess-toolsuppt,  whatprocess-CM,  whatprocess-SWEngSuppt 


ANOVAd 


Model 

df 

Mean 

Square 

F 

■■ 

1 

Regression 

13.065 

1 

13.065 

7.301 

.008® 

Residual 

137.796 

77 

1.790 

Total 

150.861 

78 

2 

Regression 

27.741 

2 

msm 

,oo~ob 

Residual 

123.120 

76 

Total 

150.861 

78 

3 

Regression 

33.983 

3 

1 

,000c 

Residual 

116.878 

75 

Total 

150.861 

78 

■■I 

a  Predictors:  (Constant),  whatprocess-toolsuppt 

b.  Predictors:  (Constant),  whatprocess-toolsuppt,  whatprocess-CM 

c  Predictors:  (Constant),  whatprocess-toolsuppt,  whatprocess-CM, 
whatprocess-SWEngSuppt 

d  Dependent  Variable:  consequence_failure_likelihood 
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Coefficients’ 


Unstandardized 

Coefficients 

Standardi 

zed 

Coefficien 

ts 

■ 

Model 

B 

Beta 

t 

1 

(Constant) 

23.259 

.000 

whatprocess-toolsuppt 

.294 

2.702 

.008 

2 

(Constant) 

24.336 

.000 

whatprocess-toolsuppt 

.511 

4.049 

.000 

whatprocess-CM 

.408 

-.380 

-3.010 

.004 

3 

(Constant) 

3.957 

.178 

22.245 

.000 

whatprocess-toolsuppt 

1.392 

.447 

.414 

3.116 

.003 

whatprocess-CM 

-1.324 

.403 

-.409 

-3.285 

.002 

whatprocess-SWEngS 

uppt 

.689 

.344 

.234 

2.001 

.049 

a  Dependent  Variable:  consequence_failure_likelihood 
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Regression 

Warnings 

For  models  with  dependent  variable 
consequence_inhouse_non_core, 
the  following  variables  are 
constants  or  have  missing 
correlations:  shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 


Variables  Entered/Removecf 


Variables 

Variables 

Model 

Entered 

Removed 

Method 

1 

enterprise- 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

web 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

2 

whatprodu 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

cts-COTS 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

a-  Dependent  Variable:  consequence_inhouse_non_core 


Model  Summary 


Std.  Error 

Change  Statistics 

Model 

R 

R  Square 

Adjusted 
R  Square 

of  the 
Estimate 

R  Square 
Change 

F  Change 

dfl 

df2 

Sig.  F 
Change 

i 

.283a 

.080 

1.2399 

.080 

6.605 

i 

Hi 

ngj 

2 

.373b 

.139 

.116 

1.2071 

.059 

5.185 

1 

— 

a- Predictors:  (Constant),  enterprise-web 
b  Predictors:  (Constant),  enterprise-web,  whatproducts-COTS 
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ANOVA' 


Model 

Sum  of 
Squares 

df 

Mean 

Square 

F 

Siq. 

1 

Regression 

10.154 

1 

10.154 

6.605 

,012a 

Residual 

116.833 

76 

1.537 

Total 

126.987 

77 

2 

Regression 

17.708 

2 

8.854 

6.077 

-Q 

^r 

o 

o 

Residual 

109.279 

75 

1.457 

Total 

126.987 

77 

a.  Predictors:  (Constant),  enterprise-web 

b-  Predictors:  (Constant),  enterprise-web,  whatproducts-COTS 

c.  Dependent  Variable:  consequence_inhouse_non_core 


Coefficients? 


Model 

Unstandardized 

Coefficients 

Standardi 

zed 

Coefficien 

ts 

t 

Sig. 

B 

Std.  Error 

Beta 

1 

(Constant) 

3.833 

.153 

25.117 

.000 

enterprise-web 

1.000 

.389 

.283 

2.570 

.012 

2 

(Constant) 

3.665 

.166 

22.073 

.000 

enterprise-web 

1.102 

.381 

.312 

2.890 

o 

o 

rj- i 

whatproducts-COTS 

.795 

.349 

.246 

2.277 

.026  | 

a-  Dependent  Variable:  consequence_inhouse_non_core 
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Regression 

Warnings 

For  models  with  dependent  variable 
consequence_inhouse_tumover, 
the  following  variables  are 
constants  or  have  missing 
correlations:  shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 


Variables  Entered/Removed 


Variables 

Variables 

Model 

Entered 

Removed 

Method 

1 

component 

-CASE 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

2 

whatproce 

ss-SWEng 

Suppt 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 

Probabilit 
y-of-F-to-r 
emove  >= 

.100). 

a  Dependent  Variable:  consequence_inhouse_turnover 


Model  Summary 


Std.  Error 

Change  Statistics 

Adjusted 

of  the 

R  Square 

Sig.  F 

Model 

R 

R  Square 

R  Square 

Estimate 

Change 

F  Change 

dfl 

df2 

Baa 

1 

KQjS 

.168 

■a 

15.559 

77 

.000 

2 

MB 

.210 

mm 

3.999 

76 

.049 

a- Predictors:  (Constant),  component-CASE 

b- Predictors:  (Constant),  component-CASE,  whatprocess-SWEngSuppt 
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ANOVAc 


Model 

Sum  of 
Squares 

df 

Mean 

Square 

F 

Sig. 

i 

Regression 

5.864 

1 

5.864 

15.559 

,000a 

Residual 

29.022 

77 

.377 

Total 

34.886 

78 

2 

Regression 

7.315 

2 

3.658 

10.082 

-6oob 

Residual 

27.571 

76 

.363 

Total 

34.886 

78 

a  Predictors:  (Constant),  component-CASE 

b  Predictors:  (Constant),  component-CASE,  whatprocess-SWEngSuppt 
c.  Dependent  Variable:  consequence_inhouse_turnover 


Coefficients 


Unstandardized 

Coefficients 

Standardi 

zed 

Coefficien 

ts 

Model 

B 

Std.  Error 

Beta 

t 

Siq. 

1 

(Constant) 

4.092 

.070 

58.108 

.000 

component-CASE 

-1.425 

.361 

-.410 

-3.944 

.000 

2 

(Constant) 

3.997 

.084 

47.695 

.000 

component-CASE 

-1.427 

.355 

-.410 

-4.024 

.000 

whatprocess-SW 

EngSuppt 

.288 

.144 

.204 

2.000 

.049 

a  Dependent  Variable:  consequence_inhouse_tumover 
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Regression 

Warnings 

For  models  with  dependent  variable 
consequence_intellectual_capital, 
the  following  variables  are 
constants  or  have  missing 
correlations:  shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 
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Variables  Entered/Removed 


Variables 

Variables 

Model 

Entered 

Removed 

Method 

1 

Stepwise 

(Criteria: 

Probabilit 

y-of-F-to-e 

whatproce 

nter  <= 

ss-fielding 

.050, 

Probabilit 
y-of-F-to-r 
emove  >= 

.100). 

2 

whatproce 

Stepwise 

(Criteria: 

Probabilit 
y-of-F-to-e 
nter  <= 

ss-training 

.050, 

Probabilit 
y-of-F-to-r 
emove  >= 

.100). 

3 

SYSTEMS 

Stepwise 

(Criteria: 

Probabilit 
y-of-F-to-e 
nter  <= 

.050, 

Probabilit 
y-of-F-to-r 
emove  >= 

.100). 

4 

BOTH  P&P 

Stepwise 

(Criteria: 

Probabilit 
y-of-F-to-e 
nter  <= 

.050, 

Probabilit 
y-of-F-to-r 
emove  >= 

.100). 

5 

component 

Stepwise 

(Criteria: 

Probabilit 
y-of-F-to-e 
nter  <= 

-domain 

.050, 

Probabilit 
y-of-F-to-r 
emove  >= 

.100). 

6 

shrink-busi 

Stepwise 

(Criteria: 

Probabilit 
y-of-F-to-e 
nter  <= 

ness 

.050, 

Probabilit 
y-of-F-to-r 
emove  >= 

.100). 

7 

component 

Stepwise 

(Criteria: 

Probabilit 
y-of-F-to-e 
nter  <= 

-CASE 

.050, 

Probabilit 
y-of-F-to-r 
!  emove  >= 

:  -100). 

8 

shrink-utilit 

Stepwise 

(Criteria: 

Probabilit 
y-of-F-to-e 
nter  <= 

ies 

.050, 

Probabilit 
y-of-F-to-r 
emove  >= 

.100). 

a  Dependent  Variable:  consequenceJntellectual_capital 
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Model  Summary 


Model 

R 

Adjusted 
R  Square 

Std.  Error 
of  the 
Estimate 

Change  Statistics 

R  Square 
Change 

F  Change 

dfl 

df2 

pB 

1 

.387a 

.150 

.139 

.9439 

.150 

13.563 

1 

77 

.469b 

.220 

.200 

.9097 

.071 

6.887 

1 

76 

.528° 

.279 

.250 

.8807 

.059 

6.093 

1 

75 

,567d 

.322 

.285 

.8599 

.043 

4.672 

1 

74 

,599e 

.359 

.315 

.8417 

.037 

4.231 

1 

73 

.043 

.631f 

.398 

.347 

.8216 

.039 

4.621 

1 

72 

.035 

.6789 

.459 

.406 

.7838 

.062 

8.117 

1 

71 

.006 

8 

,702h 

.492 

.434 

.7650 

.033 

4.535 

1 

70 

.037 

a- Predictors:  (Constant),  whatprocess-fielding 

b.  Predictors:  (Constant),  whatprocess-fielding,  whatprocess-training 

c- Predictors:  (Constant),  whatprocess-fielding,  whatprocess-training,  SYSTEMS 

d.  Predictors:  (Constant),  whatprocess-fielding,  whatprocess-training,  SYSTEMS,  BOTH  P&P 

e.  Predictors:  (Constant),  whatprocess-fielding,  whatprocess-training,  SYSTEMS,  BOTH  P&P,  co 

f- Predictors:  (Constant),  whatprocess-fielding,  whatprocess-training,  SYSTEMS,  BOTH  P&P,  com 
shrink-business 

9- Predictors:  (Constant),  whatprocess-fielding,  whatprocess-training,  SYSTEMS,  BOTH  P&P,  co 
shrink-business,  component-CASE 

h.  Predictors:  (Constant),  whatprocess-fielding,  whatprocess-training,  SYSTEMS,  BOTH  P&P,  co 
shrink-business,  component-CASE,  shrink-utilities 
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ANOVA' 


Model 

Sum  of 
Squares 

df 

Mean 

Square 

F 

Sig. 

1 

Regression 

12.083 

1 

12.083 

13.563 

,000a 

Residual 

68.600 

77 

.891 

Total 

80.684 

78 

2 

Regression 

17.783 

2 

8.892 

10.743 

,000b 

Residual 

62.900 

76 

.828 

Total 

80.684 

78 

3 

Regression 

22.509 

3 

7.503 

9.673 

,000c 

Residual 

58.174 

75 

.776 

Total 

80.684 

78 

4 

Regression 

25.964 

4 

6.491 

8.778 

,000d 

Residual 

54.719 

74 

.739 

Total 

80.684 

78 

5 

Regression 

28.962 

5 

5.792 

8.175 

,000e 

Residual 

51.722 

73 

.709 

Total 

80.684 

78 

6 

Regression 

32.081 

6 

5.347 

7.921 

o 

o 

o 

Residual 

48.602 

72 

.675 

Total 

80.684 

78 

7 

Regression 

37.068 

7 

5.295 

8.620 

.0009 

Residual 

43.616 

71 

.614 

Total 

80.684 

78 

8 

Regression 

39.721 

8 

4.965 

8.485 

,000h 

Residual 

40.962 

70 

.585 

Total 

80.684 

78 

a-  Predictors:  (Constant),  whatprocess-fielding 

b.  Predictors:  (Constant),  whatprocess-fielding,  whatprocess-training 

c-  Predictors:  (Constant),  whatprocess-fielding,  whatprocess-training,  SYSTEMS 

d.  Predictors:  (Constant),  whatprocess-fielding,  whatprocess-training,  SYSTEMS, 
BOTH  P&P 

e-  Predictors:  (Constant),  whatprocess-fielding,  whatprocess-training,  SYSTEMS, 
BOTH  P&P,  component-domain 

f-  Predictors:  (Constant),  whatprocess-fielding,  whatprocess-training,  SYSTEMS, 
BOTH  P&P,  component-domain,  shrink-business 

9-  Predictors:  (Constant),  whatprocess-fielding,  whatprocess-training,  SYSTEMS, 
BOTH  P&P,  component-domain,  shrink-business,  component-CASE 

h  Predictors:  (Constant),  whatprocess-fielding,  whatprocess-training,  SYSTEMS, 
BOTH  P&P,  component-domain,  shrink-business,  component-CASE, 
shrink-utilities 

i-  Dependent  Variable:  consequence_intellectual_capital 


Appendix  A:  Regression  for  Outsourcing  Consequences 


150 


Coefficients3 


Model 

Unstandardized 

Coefficients 

Standardi 

zed 

Coefficien 

ts 

t 

Sig. 

B 

Std.  Error 

Beta 

1  (Constant) 

4.221 

.114 

36.873 

.000 

whatprocess-fielding 

-1.130 

.307 

-.387 

-3.683 

.000 

2  (Constant) 

4.138 

.115 

36.063 

.000 

whatprocess-fielding 

-1.339 

.306 

-.459 

-4.373 

.000 

whatprocess-training 

.804 

.306 

.275 

2.624 

.010 

3  (Constant) 

4.359 

.143 

30.525 

.000 

whatprocess-fielding 

-1.370 

.297 

-.469 

-4.616 

.000 

whatprocess-training 

.773 

.297 

.265 

2.606 

.011 

SYSTEMS 

-.495 

.201 

-.243 

-2.468 

.016 

4  (Constant) 

4.892 

.283 

17.285 

.000 

whatprocess-fielding 

-1.294 

.292 

-.443 

-4.434 

.000 

whatprocess-training 

.849 

.292 

.291 

2.909 

.006 

SYSTEMS 

-.479 

.196 

-.235 

-2.446 

.017 

BOTH  P&P 

-.641 

.297 

-.211 

-2.161 

.034 

5  (Constant) 

4.825 

.279 

17.298 

.000 

whatprocess-fielding 

-1.229 

.287 

-.421 

-4.275 

.000 

whatprocess-training 

.798 

.287 

.273 

2.784 

.007 

SYSTEMS 

-.515 

.193 

-.252 

-2.673 

.009 

BOTH  P&P 

-.608 

.291 

-.200 

-2.091 

.040 

component-domain 

.811 

.394 

.195 

2.057 

.043 

6  (Constant) 

4.681 

.280 

16.698 

.000 

whatprocess-fielding 

-1.348 

.286 

-.462 

-4.714 

.000 

whatprocess-training 

.846 

.281 

.290 

3.015 

.004 

SYSTEMS 

-.480 

.189 

-.235 

-2.542 

.013 

BOTH  P&P 

-.544 

.286 

-.179 

-1.904 

.061 

component-domain 

.872 

.386 

.210 

2.260 

.027 

shrink-business 

.618 

.287 

.203 

2.150 

.035 

7  (Constant) 

4.718 

.268 

17.621 

.000 

whatprocess-fielding 

-1.269 

.274 

-.435 

-4.626 

.000 

whatprocess-training 

.799 

.268 

.274 

2.978 

.004 

SYSTEMS 

-.328 

.188 

-.161 

-1.746 

.085 

BOTH  P&P 

-.638 

.274 

-.210 

-2.324 

.023 

component-domain 

.829 

.368 

.200 

2.250 

.028 

shrink-business 

.884 

.290 

.291 

3.053 

.003 

component-CASE 

-1.465 

.514 

-.277 

-2.849 

.006 

8  (Constant) 

4.826 

.266 

18.129 

.000 

whatprocess-fielding 

-1.299 

.268 

-.445 

-4.845 

.000 

whatprocess-training 

.912 

.267 

.313 

3.414 

.001 

SYSTEMS 

-.323 

.183 

-.158 

-1.762 

.082 

BOTH  P&P 

-.753 

.273 

-.248 

-2.755 

.007 

component-domain 

1.040 

.373 

.251 

2.788 

.007 

shrink-business 

.867 

.283 

.285 

3.067 

.003 

component-CASE 

-1.480 

.502 

-.280 

-2.949 

.004 

shrink-utilities 

-1.265 

.594 

-.197 

-2.130 

.037 

a-  Dependent  Variable:  consequence  JntellectuaLcapital 
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Regression 

Warnings 

For  models  with  dependent  variable 
consequence_learning_curve,  the 
following  variables  are  constants  or 
have  missing  correlations: 
shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 


Variables  Entered/Removecf 


Model 

Variables 

Entered 

Variables 

Removed 

Method 

1 

enterprise- 

OES 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 
.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

a.  Dependent  Variable:  consequence_learning_curve 


Model  Summary 


Model 

R 

R  Square 

Adjusted 
R  Square 

Std.  Error 
of  the 
Estimate 

Change  Statistics 

R  Square 
Change 

F  Change 

dfl 

df2 

1 

.238a 

.057 

.045 

1.1151 

.057 

4.642 

i 

77 

.034  | 

a.  Predictors:  (Constant),  enterprise-OES 


ANOVAb 


Model 

Sum  of 
Squares 

df 

Mean 

Square 

F 

WM 

1  Regression 

4.642 

.034a 

Residual 

1 

Total 

wKKm 

a.  Predictors:  (Constant),  enterprise-OES 


b.  Dependent  Variable:  consequence_learning_curve 
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Coefficients3 


Unstandardized 

Coefficients 

Standardi 

zed 

Coefficien 

ts 

Model 

B 

Std.  Error 

Beta 

t 

Sig. 

1  (Constant) 

4.221 

.127 

33.214 

.000 

enterprise-OES 

-1.721 

.799 

-.238 

-2.155 

.034 

a.  Dependent  Variable:  consequence_learning_curve 


Regression 

Warnings 

For  models  with  dependent  variable 
consequence_quality,  the  following 
variables  are  constants  or  have 
missing  correlations: 
shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 


Variables  Entered/Removecf 


Variables 

Variables 

Model 

Entered 

Removed 

Method 

1 

whatprodu 

cts-COTS 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

2 

whatproce 

ss-reengin 

eering 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 

.100). 

a.  Dependent  Variable:  consequence_quality 
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Model  Summary 


Std  Error 

Change  Statistics 

Model 

R 

Adjusted 
R  Square 

of  the 
Estimate 

R  Square 
Change 

F  Change 

dfl 

df2 

mm 

1 

,305a 

1.4209 

.093 

7.917 

1 

mmm 

2 

,393b 

1.3810 

.061 

5.510 

1 

a- Predictors:  (Constant),  whatproducts-COTS 

b- Predictors:  (Constant),  whatproducts-COTS,  whatprocess-reengineering 


ANOVAc 


Model 

Sum  of 
Squares 

df 

Mean 

Square 

F 

■■ 

1 

Regression 

15.984 

1 

15.984 

7.917 

.006a 

Residual 

155.459 

77 

2.019 

Total 

171.443 

78 

2 

Regression 

26.492 

2 

13.246 

6.945 

,002b 

Residual 

144.951 

76 

1.907 

Total 

171.443 

78 

a.  Predictors:  (Constant),  whatproducts-COTS 

b.  Predictors:  (Constant),  whatproducts-COTS,  whatprocess-reengineering 

c.  Dependent  Variable:  consequence_quality 


Coefficients? 


Model 

Unstandardized 

Coefficients 

Standard  i 
zed 

Coefficien 

ts 

t 

■ 

B 

Std.  Error 

Beta 

1  (Constant) 

4.547 

.178 

25.600 

.000 

whatproducts-COTS 

-1.147 

.408 

-.305 

-2.814 

.006 

2  (Constant) 

.184 

23.881 

.000 

whatproducts-COTS 

.399 

-.334 

-3.142 

.002 

whatprocess-reengi 

.961 

.410 

.249 

2.347 

.022 

neering 

a  Dependent  Variable:  consequence_quality 
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Regression 

Warnings 

For  models  with  dependent  variable 
consequence_response_customer, 
the  following  variables  are 
constants  or  have  missing 
correlations:  shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 


Variables  Entered/Removed 


Model 

Variables 

Entered 

Variables 

Removed 

Method 

i 

whatproce 

ss-SWEng 

Suppt 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

a.  Dependent  Variable: 

consequence_response_customer 


Model  Summary 


Model 

R 

R  Square 

Adjusted 
R  Square 

Std.  Error 
of  the 
Estimate 

Chanqe  Statistics 

R  Square 
Change 

F  Change 

dfl 

df2 

Sig.  F 
Change 

1 

,290a 

.084 

.073 

.084 

1 

78 

.009 

a- Predictors:  (Constant),  whatprocess-SWEngSuppt 


ANOVAb 


Model 

df 

Mean 

Square 

F 

■■ 

1  Regression 

12.104 

1 

12.104 

7.186 

.009a 

Residual 

131.383 

1.684 

Total 

143.488 

■m 

a.  Predictors:  (Constant),  whatprocess-SWEngSuppt 

b.  Dependent  Variable:  consequence_response_customer 
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Coefficients1 


Unstandardized 

Coefficients 

Standardi 

zed 

Coefficien 

ts 

■ 

Model 

B 

Beta 

t 

1  (Constant) 

4.407 

.177 

24.955 

.000 

whatprocess- 

SWEngSuppt 

-.830 

.310 

-.290 

-2.681 

.009 

a  Dependent  Variable:  consequence_response_customer 
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Regression 

Warnings 

For  models  with  dependent  variable 
consequence_response_org_obj, 
the  following  variables  are 
constants  or  have  missing 
correlations:  shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. 


Variables  Entered /Removed 


Model 

Variables 

Entered 

Variables 

Removed 

Method 

1 

whatproce 

ss-SWEng 

Suppt 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

a.  Dependent  Variable:  consequence_response_org_obj 


Model  Summary 


Model 

R 

R  Square 

Adjusted 
R  Square 

Std.  Error 
of  the 
Estimate 

Change  Statistics 

R  Square 
Change 

F  Change 

dfl 

df2 

Sig.  F 
Change 

1 

.308a 

.095 

.083 

1.4763 

.095 

8.283 

1 

79 

.005 

a.  Predictors:  (Constant),  whatprocess-SWEngSuppt 


ANOVAb 


Model 

Mean 

Square 

F 

■9 

1  Regression 

18.052 

1 

18.052 

8.283 

Residual 

172.171 

79 

2.179 

Total 

190.222 

80 

a.  Predictors:  (Constant),  whatprocess-SWEngSuppt 


b.  Dependent  Variable:  consequence_response_org_obj 


Appendix  A:  Regression  for  Outsourcing  Consequences 


157 


Coefficients' 


Unstandardized 

Coefficients 

Standardi 

zed 

Coefficien 

ts 

■ 

Model 

B 

Std.  Error 

Beta 

t 

1  (Constant) 

4.473 

.199 

22.469 

whatprocess- 

SWEngSuppt 

-1.011 

.351 

-.308 

-2.878 

.005 

a-  Dependent  Variable:  consequence_response_org_obj 
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Regression 

Warnings 

For  models  with  dependent  variable 
consequence_rework,  the  following 
variables  are  constants  or  have 
missing  correlations: 
shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 


Variables  Entered/Removed 


Model 

Variables 

Entered 

Variables 

Removed 

Method 

1 

2 

whatprodu 

cts-COTS 

COMPONE 

NT 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 
Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 

Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

a  Dependent  Variable:  consequence_rework 


Model  Summary 


■ 

Std  Error 

Chanqe  Statistics 

Model 

R 

Adjusted 
R  Square 

of  the 
Estimate 

R  Square 
Change 

F  Change 

dfl 

df2 

Sig.  F 
Change 

1 

322a 

.092 

1.2538 

8.821 

iflil 

2 

.388b 

.151 

.128 

1.2288 

.047 

4.124 

a- Predictors:  (Constant),  whatproducts-COTS 

b.  Predictors:  (Constant),  whatproducts-COTS,  COMPONENT 
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ANOVAc 


Model 

Sum  of 
Squares 

df 

Mean 

Square 

F 

Sip. 

1 

Regression 

13.867 

1 

13.867 

8.821 

.004a 

Residua! 

119.479 

76 

1.572 

Total 

133.346 

77 

2 

Regression 

20.094 

2 

10.047 

6.654 

.002b 

Residual 

113.252 

75 

1.510 

Total 

133.346 

77 

a.  Predictors:  (Constant),  whatproducts-COTS 

b-  Predictors:  (Constant),  whatproducts-COTS,  COMPONENT 

c.  Dependent  Variable:  consequence_rework 


Coefficient^ 


Model 

Unstandardized 

Coefficients 

Standardi 

zed 

Coefficien 

ts 

t 

Sig. 

B 

Std.  Error 

Beta 

1 

(Constant) 

4.063 

.158 

25.723 

.000 

whatproducts-COTS 

1.070 

.360 

.322 

2.970 

.004 

2 

(Constant) 

3.850 

.187 

20.586 

.000 

whatproducts-COTS 

1.161 

.356 

.350 

3.262 

.002 

COMPONENT 

.610 

.301 

.218 

2.031 

.046 

a.  Dependent  Variable:  consequence_rework 
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Regression 

Warnings 

For  models  with  dependent  variable 
consequence_jisks,  the  following 
variables  are  constants  or  have 
missing  correlations: 
shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. 


Variables  Entered/Removed 


Variables 

Variables 

Model 

Entered 

Removed 

Method 

1 

ENTERPRI 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

SE 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

2 

SYSTEMS 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 

.100). 

3 

whatproce 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

ss-CM 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

a-  Dependent  Variable:  consequencej-isks 
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Model  Summary 


Model 

R 

Std.  Error 
of  the 
Estimate 

Chanqe  Statistics 

R  Square 
Chanqe 

F  Chanqe 

dfl 

df2 

Sig.  F 
Chanqe 

KBI 

,273a 

.075 

1.5101 

.075 

6.279 

1 

78 

.014 

.350b 

.123 

1.4796 

.048 

4.243 

77 

.043 

91 

.424° 

.180 

.147 

1.4403 

.057 

5.263 

76 

.025 

a  Predictors:  (Constant),  ENTERPRISE 

b.  Predictors:  (Constant),  ENTERPRISE,  SYSTEMS 

c- Predictors:  (Constant),  ENTERPRISE,  SYSTEMS,  whatprocess-CM 


ANOVAd 


Model 

Sum  of 
Squares 

df 

Mean 

Square 

F 

1 

Regression 

14.318 

1 

14.318 

6.279 

,014a 

Residual 

177.869 

2.280 

Total 

192.188 

99 

2 

Regression 

23.608 

2 

11.804 

5.392 

,006b 

Residual 

168.580 

77 

2.189 

Total 

192.188 

79 

3 

Regression 

34.527 

3 

11.509 

5.548 

.002° 

Residual 

157.661 

76 

2.074 

Total 

192.188 

79 

a-  Predictors:  (Constant),  ENTERPRISE 

b.  Predictors:  (Constant),  ENTERPRISE,  SYSTEMS 

c.  Predictors:  (Constant),  ENTERPRISE,  SYSTEMS,  whatprocess-CM 
d-  Dependent  Variable:  consequence_risks 
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Coefficient# 


Model 

Unstandardized 

Coefficients 

Standardi 

zed 

Coefficien 

ts 

t 

Sip. 

B 

Std.  Error 

Beta 

1 

(Constant) 

4.473 

.204 

21.966 

.000 

ENTERPRISE 

-.913 

,364 

-.273 

-2.606 

.014 

2 

(Constant) 

4.776 

.248 

19.269 

.000 

ENTERPRISE 

-.966 

.358 

-.289 

-2.699 

.009 

SYSTEMS 

-.694 

.337 

-.220 

-2.060 

.043 

3 

(Constant) 

5.006 

.261 

19.159 

.000 

ENTERPRISE 

-.885 

.350 

-.265 

-2.528 

.014 

SYSTEMS 

-.789 

.331 

-.251 

-2.387 

.019 

whatprocess-CM 

-.865 

.377 

-.242 

-2.294 

.025 

a  Dependent  Variable:  consequence_risks 
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Regression 

Warnings 

For  models  with  dependent  variable 
consequence_sched_flex,  the 
following  variables  are  constants  or 
have  missing  correlations: 
shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 


Variables  Entered/Removed 


Model 

Variables 

Entered 

Variables 

Removed 

Method 

1 

enterprist- 

acctng 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

a.  Dependent  Variable:  consequence_sched_flex 


Model  Summary 


Model 

R 

R  Square 

Adjusted 
R  Square 

Std.  Error 
of  the 
Estimate 

Change  Statistics 

R  Square 
Change 

F  Change 

dfl 

df2 

Sig.  F 
Change 

1 

■EES 

.051 

1.4067 

.063 

5.283 

1 

78 

.024 

a.  Predictors:  (Constant),  enterprist-acctng 


ANOVAb 


Model 

Sum  of 
Squares 

df 

Mean 

Square 

F 

■■ 

1  Regression 

1 

WBBBM 

5.283 

.024a 

Residual 

El 

I 

Total 

■m 

a.  Predictors:  (Constant),  enterprist-acctng 


b-  Dependent  Variable:  consequence_sched_flex 
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Coefficients? 


Unstandardized 

Coefficients 

Standardi 

zed 

Coefficien 

ts 

Model 

B 

Std.  Error 

Beta 

t 

Sig. 

1  (Constant) 

4.107 

.162 

25.282 

.000 

enterprist-acctng 

1.493 

.650 

.252 

2.298 

.024 

a.  Dependent  Variable:  consequence_sched_flex 
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Regression 

Warnings 

For  models  with  dependent  variable 
consequence_schedule,  the 
following  variables  are  constants  or 
have  missing  correlations: 
shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 


Variables  Entered/Removed 


a.  Dependent  Variable:  consequence_schedule 


Appendix  A:  Regression  for  Outsourcing  Consequences 

Regression 

Warnings 

For  models  with  dependent  variable 
consequence_turf_war,  the 
following  variables  are  constants  or 
have  missing  correlations: 
shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 
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Appendix  A:  Regression  for  Outsourcing  Consequences 


Variables  Entered/Removed 


Model 


Variables 

Entered 


Variables 

Removed 


Method 


1 


whatproce 

ss-SWEng 

Suppt 


whatproce 

ss-appsup 

Pt 


whatproce 

ss-toolsup 

Pt 


whatprodu 

cts-COTS 


enterprise- 

manufact 


systems-d 

evice 


Stepwise 

(Criteria: 

Probabilit 

y-of-F-to-e 

nter  <= 

.050, 

Probabilit 
y-of-F-to-r 
emove  >= 
.100). 
Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 
.050, 

Probabilit 
y-of-F-to-r 
emove  >= 
.100). 
Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 
.050, 

Probabilit 
y-of-F-to-r 
emove  >= 
.100). 
Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 
.050, 

Probabilit 
y-of-F-to-r 
emove  >= 
.100). 
Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <- 
.050, 

Probabilit 
y-of-F-to-r 
emove  >= 
.100). 
Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 
.050, 

Probabilit 
y-of-F-to-r 
emove  >- 
.1001. 


a.  Dependent  Variable:  consequence_turf_war 
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Model  Summary 


Model 

R 

R  Square 

Adjusted 

R  Square 

Std.  Error 
of  the 
Estimate 

Chanqe  Statistics 

R  Square 
Chanqe 

F  Chanqe 

dfl 

df2 

Sig.  F 
Change 

i 

.281 a 

.079 

1.1534 

.079 

6.423 

1 

75 

.013 

Ep 

.51 9b 

.270 

1.0339 

.191 

19.331 

1 

74 

.000 

.572° 

.327 

.9989 

.058 

6.274 

1 

73 

.014 

Eli 

,613d 

.376 

.342 

.9687 

.049 

5.621 

1 

72 

.020 

.645e 

.415 

.374 

.9443 

.039 

4.771 

1 

71 

.032 

■ 

.669f 

.447 

.400 

.9246 

.032 

4.059 

1 

70 

.048 

a- Predictors:  (Constant),  whatprocess-SWEngSuppt 

b.  Predictors:  (Constant),  whatprocess-SWEngSuppt,  whatprocess-appsuppt 

c.  Predictors:  (Constant),  whatprocess-SWEngSuppt,  whatprocess-appsuppt,  whatprocess-toolsu 

d-  Predictors:  (Constant),  whatprocess-SWEngSuppt,  whatprocess-appsuppt,  whatprocess-toolsu 
whatproducts-COTS 

e- Predictors:  (Constant),  whatprocess-SWEngSuppt,  whatprocess-appsuppt,  whatprocess-toolsu 
whatproducts-COTS,  enterprise-manufact 

f  Predictors:  (Constant),  whatprocess-SWEngSuppt,  whatprocess-appsuppt,  whatprocess-toolsup 
whatproducts-COTS,  enterprise-manufact,  systems-device 
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ANOVAP 


Model 

Sum  of 
Squares 

df 

Mean 

Square 

F 

Sig. 

1 

Regression 

8.544 

1 

8.544 

6.423 

.01 3a 

Residual 

99.768 

75 

1.330 

Total 

108.312 

76 

2 

Regression 

29.208 

2 

14.604 

13.662 

,000b 

Residual 

79.104 

74 

1.069 

Total 

108.312 

76 

3 

Regression 

35.469 

3 

11.823 

11.848 

.000° 

Residual 

72.843 

73 

.998 

Total 

108.312 

76 

4 

Regression 

40.743 

4 

10.186 

10.854 

,000d 

Residual 

67.568 

72 

.938 

Total 

108.312 

76 

5 

Regression 

44.998 

5 

9.000 

10.092 

,000e 

Residual 

63.314 

71 

.892 

Total 

108.312 

76 

6 

Regression 

48.468 

6 

8.078 

9.449 

o 

o 

o 

Residual 

59.843 

70 

.855 

Total 

108.312 

76 

a-  Predictors:  (Constant),  whatprocess-SWEngSuppt 

6-  Predictors:  (Constant),  whatprocess-SWEngSuppt,  whatprocess-appsuppt 

c-  Predictors:  (Constant),  whatprocess-SWEngSuppt,  whatprocess-appsuppt, 
whatprocess-toolsuppt 

d  Predictors:  (Constant),  whatprocess-SWEngSuppt,  whatprocess-appsuppt, 
whatprocess-toolsuppt,  whatproducts-COTS 

e  Predictors:  (Constant),  whatprocess-SWEngSuppt,  whatprocess-appsuppt, 
whatprocess-toolsuppt,  whatproducts-COTS,  enterprise-manufact 

f-  Predictors:  (Constant),  whatprocess-SWEngSuppt,  whatprocess-appsuppt, 
whatprocess-toolsuppt,  whatproducts-COTS,  enterprise-manufact, 
systems-device 

9-  Dependent  Variable:  consequence_turf_war 
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Coefficients1 


Standardi 

zed 

Unstandardized 

Coefficien 

Coefficients 

ts 

Model 

B 

Std.  Error 

Beta 

t 

■ 

1 

(Constant) 

4.373 

.162 

.000 

whatprocess-SWEngS 

uppt 

.704 

.278 

.281 

2.534 

.013 

2 

(Constant) 

4.406 

.145 

30.391 

.000 

whatprocess-SWEngS 

uppt 

1.326 

.286 

.529 

4.628 

.000 

whatprocess-appsuppt 

-1.702 

.387 

-.502 

-4.397 

.000 

3 

(Constant) 

4.347 

.142 

30.607 

.000 

whatprocess-SWEngS 

uppt 

1.065 

.296 

.425 

3.605 

.001 

whatprocess-appsu  ppt 

-1.919 

.384 

-.566 

-4.998 

.000 

whatprocess-toolsuppt 

.805 

.321 

.281 

2.505 

.014 

4 

(Constant) 

4.231 

.146 

28.938 

.000 

whatprocess-SWEngS 

uppt 

1.079 

.287 

.430 

3.762 

.000 

whatprocess-appsuppt 

-2.063 

.377 

-.609 

-5.470 

.000 

whatprocess-toolsuppt 

.813 

.312 

.284 

2.608 

.011 

whatproducts-COTS 

.671 

.283 

.224 

2.371 

.020 

5 

(Constant) 

4.228 

.143 

29.669 

.000 

whatprocess-SWEngS 

uppt 

1.089 

.280 

.434 

3.896 

.000 

whatprocess-appsuppt 

-2.246 

.377 

-.663 

-5.956 

whatprocess-toolsuppt 

.738 

.306 

.258 

2.413 

whatproducts-COTS 

.738 

.278 

.247 

2.658 

.010 

enterprise-manufact 

2.191 

1.003 

.209 

2.184 

.032 

6 

(Constant) 

4.166 

.143 

29.145 

.000 

whatprocess-SWEngS 

uppt 

1.072 

.274 

.427 

3.914 

.000 

whatprocess-appsuppt 

-2.573 

.403 

-.759 

-6.380 

.000 

whatprocess-toolsuppt 

.843 

.304 

.295 

2.775 

.007 

whatprod  ucts-COT  S 

.867 

.279 

.289 

3.103 

.003 

enterprise-manufact 

2.492 

.994 

.238 

2.508 

.014 

systems-device 

.966 

.479 

.201 

2.015 

.048 

a-  Dependent  Variable:  consequence_turf_war 
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Regression 

Warnings 

For  models  with  dependent  variable 
consequence_visibility,  the  following 
variables  are  constants  or  have 
missing  correlations: 
shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 


Variables  Entered/Removecf 


Variables 

Variables 

Model 

Entered 

Removed 

Method 

1 

whatproce 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

ss-reengin 

.050, 

eering 

Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

2 

whatprodu 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

cts-none 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

3 

whatprodu 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

cts-custom 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

a  Dependent  Variable:  consequence_visibility 
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Model  Summary 


Model 

R 

Adjusted 
R  Square 

Std.  Error 
of  the 
Estimate 

Chanqe  Statistics 

R  Square 
Change 

F  Chanqe 

dfl 

df2 

1 

.31 5a 

1.2679 

.099 

8.585 

1 

.004 

,389b 

IB 

.052 

4.746 

1 

1 

.032 

.442° 

.196 

iasHMlSZS 

WSSk 

.044 

4.174 

1 

WmS 

.045 

a- Predictors:  (Constant),  whatprocess-reengineering 

b-  Predictors:  (Constant),  whatprocess-reengineering,  whatproducts-none 

c- Predictors:  (Constant),  whatprocess-reengineering,  whatproducts-none,  whatproducts-custom 


ANOVAd 


Model 

B  1 

df 

Mean 

Square 

F 

■■ 

1 

Regression 

13.800 

1 

13.800 

8.585 

.004a 

Residual 

125.387 

El 

1.608 

Total 

139.188 

■El 

2 

Regression 

21.080 

1 

wmmm 

6.872 

,002b 

Residual 

118.107 

1 

Total 

139.188 

1 

3 

Regression 

27.229 

3 

mem 

6.161 

,001c 

Residual 

111.958 

76 

Total 

139.188 

79 

■1 

a-  Predictors:  (Constant),  whatprocess-reengineering 

b  Predictors:  (Constant),  whatprocess-reengineering,  whatproducts-none 

c-  Predictors:  (Constant),  whatprocess-reengineering,  whatproducts-none, 
whatproducts-custom 

d  Dependent  Variable:  consequence_visibility 
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Coefficients1 


Unstandardized 

Coefficients 

Standardi 

zed 

Coefficien 

ts 

Model 

B 

Std.  Error 

Beta 

t 

Sig. 

i 

(Constant) 

3.121 

.156 

19.999 

.000 

whatprocess-reengin 

eering 

1.093 

.373 

.315 

2.930 

.004 

2 

(Constant) 

3.063 

.155 

19.782 

.000 

whatprocess-reengin 

eering 

1.152 

.365 

.332 

3.152 

.002 

whatproducts-none 

1.937 

.889 

.229 

2.179 

.032 

3 

(Constant) 

2.623 

.263 

9.959 

.000 

whatprocess-reengin 

eering 

1.100 

.359 

.317 

3.064 

.003 

whatproducts-none 

2.377 

.898 

.281 

2.648 

.010 

whatproducts-custom 

.625 

.306 

.217 

2.043 

.045 

a  Dependent  Variable:  consequence_visibility 
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Regression 

Warnings 

For  models  with  dependent  variable 
goal_rslt_add_people_capacity,  the 
following  variables  are  constants  or 
have  missing  correlations: 
shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 


Variables  Entered/Removed 


a.  Dependent  Variable:  goal_rslt_add_people_capacity 
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Regression 

Warnings 

For  models  with  dependent  variable 
goal_rslt_add_people_short,  the 
following  variables  are  constants  or 
have  missing  correlations: 
shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 


Variables  Entered/Removecf 


Model 

Variables 

Entered 

Variables 

Removed 

Method 

1 

2 

whatprodu 

cts-commo 

n-cust 

enterprist- 

acctng 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 
Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

a  Dependent  Variable:  goa!_rslt_add_people_short 


Model  Summary 


Std.  Error 

Change  Statistics 

Model 

R 

R  Square 

Adjusted 
R  Square 

of  the 
Estimate 

R  Square 
Change 

F  Change 

dfl 

df2 

Sig.  F 
Change 

1 

.37 1 a 

.138 

.122 

.6990 

.138 

8.930 

1 

56 

.004 

2 

,477b 

.227 

CD 

CD 

.6677 

.090 

6.379 

1 

55 

.014 

a.  Predictors:  (Constant),  whatproducts-common-cust 


b.  Predictors:  (Constant),  whatproducts-common-cust,  enterprist-acctng 
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ANOVAc 


Model 

Sum  of 
Squares 

df 

Mean 

Square 

F 

Siq. 

1 

Regression 

4.363 

1 

4.363 

8.930 

,004a 

Residual 

27.361 

56 

.489 

Total 

31.724 

57 

2 

Regression 

7.207 

2 

3.603 

8.083 

-Q 

o 

o 

Residual 

24.517 

55 

.446 

Total 

31.724 

57 

a  Predictors:  (Constant),  whatproducts-common-cust 
b  Predictors:  (Constant),  whatproducts-common-cust,  enterprist-acctng 
c-  Dependent  Variable:  goal_rslt_add_people_short 


Coefficients' 


Unstandardized 

Coefficients 

Standardi 

zed 

Coefficien 

ts 

Model 

B 

Std.  Error 

Beta 

t 

Siq. 

1 

(Constant) 

3.093 

.107 

29.016 

.000 

whatproducts-co 

mmon-cust 

-.626 

.210 

-.371 

-2.988 

.004 

2 

(Constant) 

3.032 

.105 

28.976 

.000 

whatproducts-co 

mmon-cust 

-.624 

.200 

-.369 

-3.115 

cO 

o 

o 

enterprist-acctng 

.874 

_  *346 

.299 

2.526 

.014  | 

a-  Dependent  Variable:  goal_rslt_add_people_short 
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Regression 

Warnings 

For  models  with  dependent  variable 
goal_rslt_cash,  the  following 
variables  are  constants  or  have 
missing  correlations: 
enterprise-manufact, 
shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 


Variables  Entered/Removecf 


Variables 

Variables 

Model 

Entered 

Removed 

Method 

1 

systems-d 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

evice 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

2 

enterprise- 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

web 

.050, 

Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

a.  Dependent  Variable:  goal_rslt_cash 


Model  Summary 


Std.  Error 

Change  Statistics 

Model 

R 

R  Square 

Adjusted 
R  Square 

of  the 
Estimate 

R  Square 
Change 

F  Change 

dfl 

df2 

Sig.  F 
Change 

1 

.603a 

.363 

.350 

.4953 

.363 

27.396 

1 

48 

.000 

2 

.653b 

.426 

.402 

.4751 

.063 

5.171 

1 

47 

.028 

a. Predictors:  (Constant),  systems-device 


b. Predictors:  (Constant),  systems-device,  enterprise-web 
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ANOVAc 


Model 

Sum  of 
Squares 

df 

Mean 

Square 

F 

Siq. 

1 

Regression 

6.722 

1 

6.722 

27.396 

.000a 

Residual 

11778 

48 

.245 

Total 

18.500 

49 

2 

Regression 

7.890 

2 

3.945 

17.474 

.000b 

Residual 

10.610 

47 

.226 

Total 

18.500 

49 

a  Predictors:  (Constant),  systems-device 
b  Predictors:  (Constant),  systems-device,  enterprise-web 
c-  Dependent  Variable:  goal_rslt_cash 


Coefficients? 


Model 

Unstandardized 

Coefficients 

Standardi 

zed 

Coefficien 

ts 

t 

Sig. 

B 

Std.  Error 

Beta 

1 

(Constant) 

2.822 

.074 

38.220 

.000 

systems-device 

-1.222 

.234 

-.603 

-5.234 

.000 

2 

(Constant) 

2.879 

.075 

38.325 

.000 

systems-device 

-1.023 

.241 

-.504 

-4.253 

.000 

enterprise-web 

-.427 

.188 

-.270 

-2.274 

.026 

a.  Dependent  Variable:  goal_rslt_cash 
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Regression 

Warnings 

For  models  with  dependent  variable 
goal_/slt_control,  the  following 
variables  are  constants  or  have 
missing  correlations: 
shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 


Variables  Entered/Rem  oved 


Variables 

Variables 

Model 

Entered 

Removed 

Method 

1 

whatproce 

ss-reengin 

eering 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

2 

whatproce 

ss-require 

ments 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 

.100). 

a  Dependent  Variable:  goal_rslt_control 


Model  Summary 


Std.  Error 

Change  Statistics 

Adjusted 

of  the 

R  Square 

Sig.  F 

Model 

R 

R  Square 

R  Square 

Estimate 

Change 

F  Change 

dfl 

df2 

Change 

1 

.305a 

.093 

.079 

1.0050 

.093 

6.453 

1 

63 

.014 

2 

.425b 

.181 

.154 

.9628 

.088 

6.641 

1 

62 

.012 

a- Predictors:  (Constant),  whatprocess-reengineering 


b.  Predictors:  (Constant),  whatprocess-reengineering,  whatprocess-requirements 
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ANOVAc 


Model 

Sum  of 
Squares 

df 

Mean 

Square 

F 

Sig. 

1 

Regression 

6.518 

1 

6.518 

6.453 

.014a 

Residual 

63.636 

63 

1.010 

Total 

70.154 

64 

2 

Regression 

12.675 

2 

6.337 

6.836 

,002b 

Residual 

57.479 

62 

.927 

Total 

70.154 

64 

a  Predictors:  (Constant),  whatprocess-reengineering 

b  Predictors:  (Constant),  whatprocess-reengineering,  whatprocess-requirements 
c  Dependent  Variable:  goal_rslt_control 


Coefficients? 


Unstandardized 

Coefficients 

Standardi 

zed 

Coefficien 

ts 

Model 

B 

Std.  Error 

Beta 

t 

Sig. 

1 

(Constant) 

2.373 

.141 

16.859 

.000 

whatprocess-r 

eengineering 

.770 

.303 

.305 

2.540 

.014 

2 

(Constant) 

2.547 

.151 

16.880 

.000 

whatprocess-r 

eengineering 

.987 

.302 

.391 

3.264 

.002 

whatprocess-r 

equirements 

-.685 

.266 

-.308 

-2.577 

.012 

a.  Dependent  Variable:  goal_rslt_control 
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Regression 

Warnings 

For  models  with  dependent  variable 
goal_rslt_expertise,  the  following 
variables  are  constants  or  have 
missing  correlations: 
shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 


Variables  Entered/Removecf 


Variables 

Variables 

Model 

Entered 

Removed 

Method 

1 

SYSTEMS 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

2 

shrink-inter 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

net 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

3 

whatproce 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

ss-reengin 

.050, 

eering 

Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

a  Dependent  Variable:  goal_rslt_expertise 
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Model  Summary 


Model 

R 

Adjusted 
R  Square 

Std.  Error 
of  the 
Estimate 

Change  Statistics 

R  Square 
Change 

F  Change 

dfl 

df2 

Sig.  F 
Change 

1 

.269a 

.072 

.059 

.9529 

.072 

5.309 

1 

68 

.024 

2 

,363b 

.132 

.106 

.9289 

.059 

4.567 

1 

67 

.036 

3 

.442° 

.195 

.159 

.9009 

.064 

5.219 

1 

66 

.026 

a-  Predictors:  (Constant),  SYSTEMS 

b- Predictors:  (Constant),  SYSTEMS,  shrink-internet 

c- Predictors:  (Constant),  SYSTEMS,  shrink-internet,  whatprocess-reengineering 


ANOVAd 


Model 

df 

Mean 

Square 

F 

Sig. 

1 

Regression 

4.821 

1 

4.821 

5.309 

TO 

CNJ 

O 

Residual 

61.750 

68 

.908 

Total 

66.571 

69 

2 

Regression 

8.762 

2 

4.381 

5.078 

,009b 

Residual 

57.809 

67 

.863 

Total 

66.571 

69 

3 

Regression 

12.999 

3 

4.333 

5.338 

.002c 

Residual 

53.572 

66 

.812 

Total 

66.571 

69 

a-  Predictors:  (Constant),  SYSTEMS 

b.  Predictors:  (Constant),  SYSTEMS,  shrink-internet 

c.  Predictors:  (Constant),  SYSTEMS,  shrink-internet,  whatprocess-reengineering 

d.  Dependent  Variable:  goal_rslt_expertise 
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Coefficients1 


Unstandardized 

Coefficients 

Standardi 

zed 

Coefficien 

ts 

Model 

B 

Std.  Error 

Beta 

t 

Siq. 

1 

(Constant) 

2.929 

.147 

19.917 

.000 

SYSTEMS 

.536 

.232 

.269 

2.304 

.024 

2 

(Constant) 

2.973 

.145 

20.528 

.000 

SYSTEMS 

.591 

.228 

.297 

2.591 

.012 

shrink-internet 

-.927 

.434 

-.245 

-2.137 

.036 

3 

(Constant) 

2.864 

.148 

19.311 

.000 

SYSTEMS 

.592 

.221 

.297 

2.676 

.000 

shrink-internet 

-1.203 

.438 

-.318 

-2.748 

o 

o 

rn 

whatprocess-r 

eengineering 

.640 

.280 

.263 

2.285 

.026 

a-  Dependent  Variable:  goal_rslt_expertise 
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Regression 

Warnings 

For  models  with  dependent  variable 
goal_rslt_non_core,  the  following 
variables  are  constants  or  have 
missing  correlations: 
shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 


Variables  Entered/Removed 


Variables 

Variables 

Model 

Entered 

Removed 

Method 

1 

systems-d 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

evice 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 

.100). 

2 

whatprodu 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

cts-COTS 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

a  Dependent  Variable:  goal_rslt_non_core 


Model  Summary 


Std.  Error 

Change  Statistics 

Model 

R 

R  Square 

Adjusted 
R  Square 

of  the 
Estimate 

R  Square 
Change 

F  Change 

dfl 

df2 

Sig.  F 
Change 

i 

.262a 

.069 

.053 

.7536 

.069 

4.436 

1 

60 

.039 

2 

,364b 

.132 

.103 

.7337 

.063 

4.309 

1 

59 

.042 

a.  Predictors:  (Constant),  systems-device 


b.  Predictors:  (Constant),  systems-device,  whatproducts-COTS 
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ANOVAc 


Model 

Sum  of 
Squares 

df 

Mean 

Square 

F 

Siq. 

1 

Regression 

2.520 

1 

2.520 

4.436 

,039a 

Residual 

34.077 

60 

.568 

Total 

36.597 

61 

2 

Regression 

4.839 

2 

2.420 

4.495 

.01 5b 

Residual 

31.758 

59 

.538 

Total 

36.597 

61 

a-  Predictors:  (Constant),  systems-device 

b-  Predictors:  (Constant),  systems-device,  whatproducts-COTS 

c-  Dependent  Variable:  goal_rslt_non_core 


Coefficients* 


Model 

Unstandardized 

Coefficients 

Standardi 

zed 

Coefficien 

ts 

t 

Sig. 

B 

Std.  Error 

Beta 

1 

(Constant) 

3.140 

.100 

31.460 

.000 

systems-device 

-.740 

.352 

-.262 

-2.106 

.039 

2 

(Constant) 

3.250 

.in 

29.384 

.000 

systems-device 

-.850 

.346 

-.301 

-2.455 

.017 

whatproducts-COTS 

-.481 

.232 

-.255 

-2.076 

.042 

a.  Dependent  Variable:  goal_rslt_non_core 
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Regression 

Warnings 

For  models  with  dependent  variable 
goal_rslt_quality,  the  following 
variables  are  constants  or  have 
missing  correlations: 
shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 


Variables  Entered/Rem ovetJ 


Model 

Variables 

Entered 

Variables 

Removed 

Method 

1 

systems-d 

evice 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 
.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

a.  Dependent  Variable:  goal_rslt_quality 


Model  Summary 


Model 

R 

R  Square 

Adjusted 
R  Square 

Std.  Error 
of  the 
Estimate 

Change  Statistics 

R  Square 
Change 

F  Change 

dfl 

df2 

Sig.  F 
Change 

1 

.329® 

.109 

.094 

1.0385 

.109 

7.547 

i 

62 

.008 

a.  Predictors:  (Constant),  systems-device 


ANOVAb 


Model 

Sum  of 
Squares 

df 

Mean 

Square 

F 

Sig. 

1  Regression 

8.139 

1 

8.139 

7.547 

.008® 

Residual 

66.861 

62 

1.078 

Total 

75.000 

63 

a-  Predictors:  (Constant),  systems-device 
6-  Dependent  Variable:  goal_rslt_quality 
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Coefficients' 


Unstandardized 

Coefficients 

Standardi 

zed 

Coefficien 

ts 

■ 

Model 

B 

t 

1  (Constant) 

2.729 

20.184 

.000 

systems-device 

-1.329 

■KH 

-2.747 

.006 

a.  Dependent  Variable:  goal_rslt_quality 
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Regression 

Warnings 

For  models  with  dependent  variable 
goal_rslt_reduce_cost_economies, 
the  following  variables  are 
constants  or  have  missing 
correlations:  shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. 


Variables  Entered/Removecf 


Model 

Variables 

Entered 

Variables 

Removed 

Method 

i 

whatproce 

ss-fielding 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

a.  Dependent  Variable: 

goal_rslt_reduce_cost_economies 


Model  Summary 


Model 

R 

R  Square 

Adjusted 
R  Square 

Std.  Error 
of  the 
Estimate 

Change  Statistics 

R  Square 
Change 

F  Change 

dfl 

df2 

Sig.  F 
Change 

1 

.253a 

.064 

.050 

.8821 

.064 

4.508 

1 

66 

.037 

a.  Predictors:  (Constant),  whatprocess-fielding 


ANOVAb 


Model 

Sum  of 
Squares 

df 

Mean 

Square 

F 

Sig. 

1  Regression 

3.508 

1 

3.508 

4.508 

,037a 

Residual 

51.359 

66 

.778 

Total 

54.868 

67 

a  Predictors:  (Constant),  whatprocess-fielding 
b.  Dependent  Variable:  goal_rslt_reduce_cost_economies 
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Coefficients’ 


Unstandardized 

Coefficients 

Standardi 

zed 

Coefficien 

ts 

Model 

B 

Std.  Error 

Beta 

t 

Sig. 

1  (Constant) 

2.655 

.119 

22.317 

.000 

whatprocess-fielding 

-.578 

.272 

-.253 

-2.123 

.037 

a.  Dependent  Variable:  goal_rslt_reduce_cost_economies 
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Regression 

Warnings 

For  models  with  dependent  variable 
goal_rslt_reduce_sched_parallel, 
the  following  variables  are 
constants  or  have  missing 
correlations:  shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 


Variables  Entered/Removecf 


Model 

Variables 

Entered 

Variables 

Removed 

Method 

1 

2 

whatproce 

ss-SWEng 

Suppt 

systems-a 

vionics 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 
Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

a  Dependent  Variable:  goal_rslt_reduce_sched_parallel 


Model  Summary 


Std.  Error 

Change  Statistics 

Model 

R 

R  Square 

Adjusted 
R  Square 

of  the 
Estimate 

R  Square 
Change 

F  Change 

dfl 

df2 

Sig.  F 
Change 

1 

,301a 

.091 

.077 

.8288 

.091 

6.788 

1 

68 

.011 

2 

.409b 

.167 

.142 

.7991 

.077 

6.155 

1 

67 

.016 

a- Predictors:  (Constant),  whatprocess-SWEngSuppt 

b- Predictors:  (Constant),  whatprocess-SWEngSuppt,  systems-avionics 
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ANOVAc 


Model 

Sum  of 
Squares 

df 

Mean 

Square 

F 

Sig. 

1 

Regression 

4.663 

1 

4.663 

6.788 

.01 1a 

Residual 

46.709 

68 

.687 

Total 

51.371 

69 

2 

Regression 

8.593 

2 

4.296 

6.729 

.002b 

Residual 

42.778 

67 

.638 

Total 

51.371 

69 

a  Predictors:  (Constant),  whatprocess-SWEngSuppt 

b-  Predictors:  (Constant),  whatprocess-SWEngSuppt,  systems-avionics 

c  Dependent  Variable:  goal_rslt_reduce_sched_parallel 


Coefficients? 


Standardi 

zed 

Unstandardized 

Coefficien 

Coefficients 

ts 

Model 

B 

Std.  Error 

Beta 

t 

Siq. 

1 

(Constant) 

2.723 

.121 

22.528 

O 

o 

Q 

whatprocess-SW 

EngSuppt 

-.549 

.211 

-.301 

-2.605 

.011 

2 

(Constant) 

2.701 

.117 

23.107 

.000 

whatprocess-SW 

EngSuppt 

-.664 

.208 

-.364 

-3.184 

.002 

systems-avionics 

1.047 

.422 

.284 

2.481 

.016 

a-  Dependent  Variable:  goal_rslt_reduce_sched_parallel 
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Regression 

Warnings 

For  models  with  dependent  variable 
goal_rslt_reduce_sched_vendor, 
the  following  variables  are 
constants  or  have  missing 
correlations:  shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 


Variables  Entered/Removecf 


Model 

Variables 

Entered 

Variables 

Removed 

Method 

1 

whatproce 

ss-require 

ments 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

a.  Dependent  Variable:  goal_rslt_reduce_sched_vendor 


Model  Summary 


Model 

R 

R  Square 

Adjusted 
R  Square 

Std.  Error 
of  the 
Estimate 

Change  Statistics 

R  Square 
Change 

F  Change 

dfl 

df2 

Sig.  F 
Change 

i 

,261a 

.068 

.055 

.9952 

.068 

5.039 

1 

69 

.028 

a. Predictors:  (Constant),  whatprocess-requirements 


ANOVAb 


Model 

Sum  of 
Squares 

df 

Mean 

Square 

F 

Sig. 

1  Regression 

4.990 

1 

4.990 

5.039 

.028a 

Residual 

68.334 

69 

.990 

Total 

73.324 

70 

a  Predictors:  (Constant),  whatprocess-requirements 
Dependent  Variable:  goal_rslt_reduce_sched_vendor 
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Coefficients' 


Unstandardized 

Coefficients 

Standardi 

zed 

Coefficien 

ts 

■ 

Model 

B 

Std.  Error 

Beta 

t 

1  (Constant) 

15.791 

> 

O 

O 

whatprocess- 

requirements 

.261 

2.245 

.026 

a-  Dependent  Variable:  goal_rslt_reduce_sched_vendor 
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Regression 

Warnings 

For  models  with  dependent  variable 
goal_rslt_response_cust,  the 
following  variables  are  constants  or 
have  missing  correlations: 
shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 
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Variables  Entered/Removecf 


Model 


Variables 

Entered 


Variables 

Removed 


Method 


1 


whatproce 

ss-SWEng 

Suppt 


systems-d 

evice 


enterprise- 

OES 


systems-a 

vionics 


Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 
.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 
Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 
.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 
Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 
.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 
Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 
.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 


a-  Dependent  Variable:  goal_rslt_response_cust 
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Model  Summary 


Model 

R 

R  Square 

Adjusted 
R  Square 

Change  Statistics 

R  Square 
Change 

df2 

pa 

1 

.362® 

.131 

.118 

.9953 

.131 

9.676 

64 

.003 

,464b 

.215 

.190 

.9536 

6.716 

H 

63 

.012 

ms. 

.518° 

.268 

.233 

.9282 

4.503 

H 

62 

.038 

tM 

,560d 

.313 

.268 

.9064 

4.016 

61 

.050 

a- Predictors:  (Constant),  whatprocess-SWEngSuppt 

b-  Predictors:  (Constant),  whatprocess-SWEngSuppt,  systems-device 

c- Predictors:  (Constant),  whatprocess-SWEngSuppt,  systems-device,  enterprise-OES 

d- Predictors:  (Constant),  whatprocess-SWEngSuppt,  systems-device,  enterprise-OES,  systems- 

ANOVAe 


Model 

df 

Mean 

Square 

F 

■■ 

1 

Regression 

9.585 

1 

9.585 

.003® 

Residual 

63.399 

64 

.991 

Total 

72.985 

65 

2 

Regression 

15.693 

2 

7.847 

8.628 

.000b 

Residual 

57.292 

63 

.909 

Total 

72.985 

65 

3 

Regression 

19.572 

3 

6.524 

7.573 

,000c 

Residual 

53.413 

62 

.861 

Total 

72.985 

65 

4 

Regression 

22.872 

4 

5.718 

6.960 

,000d 

Residual 

50.113 

61 

.822 

Total 

72.985 

65 

a  Predictors:  (Constant),  whatprocess-SWEngSuppt 

b-  Predictors:  (Constant),  whatprocess-SWEngSuppt,  systems-device 

c  Predictors:  (Constant),  whatprocess-SWEngSuppt,  systems-device, 
enterprise-OES 

d-  Predictors:  (Constant),  whatprocess-SWEngSuppt,  systems-device, 
enterprise-OES,  systems-avionics 

e  Dependent  Variable:  goal_rslt_response_cust 
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Coefficients' 


Unstandardized 

Coefficients 

Standardi 

zed 

Coefficien 

ts 

Model 

B 

Std.  Error 

Beta 

t 

Sig. 

1 

(Constant) 

2.930 

.152 

19.306 

.000 

whatprocess-SW 

EngSuppt 

-.800 

.257 

-.362 

-3.111 

.003 

2 

(Constant) 

2.984 

.147 

20.313 

.000 

whatprocess-SW 

EngSuppt 

-.702 

.249 

-.318 

-2.818 

.006 

systems-device 

-1.163 

.449 

-.293 

-2.592 

.012 

3 

(Constant) 

2.949 

.144 

20.481 

.000 

whatprocess-SW 

EngSuppt 

-.736 

.243 

-.333 

-3.026 

.004 

systems-device 

-1.107 

.438 

-.279 

-2.531 

.014 

enterprise-OES 

1.419 

.669 

.231 

2.122 

.038 

4 

(Constant) 

2.920 

.141 

20.658 

.000 

whatprocess-SW 

EngSuppt 

-.849 

.244 

-.385 

-3.479 

.001 

systems-device 

-1.010 

.430 

-.254 

-2.349 

.022 

enterprise-OES 

1.505 

.654 

.245 

2.299 

.025 

systems-avionics 

.967 

.483 

.219 

2.004 

.050 

a  Dependent  Variable:  goal_rslt_response_cust 


Appendix  B:  Regression  for  Outsourcing  Goals 


198 


Regression 

Warnings 

For  models  with  dependent  variable 
goal_rslt_response_org,  the 
following  variables  are  constants  or 
have  missing  correlations: 
shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 


Variables  Entered/Removed 


Model 

Variables 

Entered 

Variables 

Removed 

Method 

1 

2 

3 

systems-d 

evice 

whatproce 

ss-SWEng 

Suppt 

whatproce 

ss-coding 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 

Probabilit 
y-of-F-to-r 
emove  >= 
.100). 
Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 

Probabilit 
y-of-F-to-r 
emove  >= 
.100). 
Stepwise 
(Criteria:  | 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

a-  Dependent  Variable:  goal_rslt_response_org 
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Model  Summary 


Model 

R 

R  Square 

Adjusted 
R  Square 

Std.  Error 
of  the 
Estimate 

Change  Statistics 

R  Square 
Change 

F  Change 

dfl 

df2 

Sig.  F 
Change 

.125 

.112 

.9846 

1 

67 

.003 

.  I 

.175 

.150 

.9632 

1 

66 

1 

.238 

.203 

.9325 

5.418 

1 

65 

.023  | 

a- Predictors:  (Constant),  systems-device 

b-  Predictors:  (Constant),  systems-device,  whatprocess-SWEngSuppt 

c- Predictors:  (Constant),  systems-device,  whatprocess-SWEngSuppt,  whatprocess-coding 


ANOVAd 


Model 

df 

Mean 

Square 

F 

■■ 

1 

Regression 

9.253 

1 

9.253 

9.545 

,003a 

Residual 

64.950 

67 

.969 

Total 

74.203 

68 

2 

Regression 

12.965 

2 

6.483 

6.987 

,002b 

Residual 

61.237 

66 

.928 

Total 

74.203 

68 

3 

Regression 

17.677 

3 

5.892 

6.776 

.000° 

Residual 

56.526 

65 

.870 

Total 

74.203 

68 

a-  Predictors:  (Constant),  systems-device 

b-  Predictors:  (Constant),  systems-device,  whatprocess-SWEngSuppt 

c-  Predictors:  (Constant),  systems-device,  whatprocess-SWEngSuppt, 
whatprocess-coding 

d-  Dependent  Variable:  goal_rslt_response_.org 
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Coefficients? 


Standardi 

zed 

Unstandardized 

Coefficien 

Coefficients 

ts 

Model 

B 

Std.  Error 

Beta 

t 

Sig. 

1 

(Constant) 

2.813 

.123 

22.852 

.000 

systems-device 

-1.413 

.457 

-.353 

-3.089 

.003 

2 

(Constant) 

2.968 

.143 

20.702 

.000 

systems-device 

-1.269 

.453 

-.317 

-2.802 

.007 

whatprocess-SWEn 

gSuppt 

-.498 

.249 

-.227 

-2.000 

.050 

3 

(Constant) 

2.310 

.315 

7.329 

' — > 
o 

p 

systems-device 

-1.178 

.440 

-.294 

-2.675 

.009 

whatprocess-SWEn 

gSuppt 

-.610 

.246 

-.277 

-2.479 

.016 

whatprocess-coding 

.792 

.340 

.257 

2.328 

.023 

a  Dependent  Variable:  goal_rslt_response_org 
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Regression 

Warnings 

For  models  with  dependent  variable 
goal_rslt_risk_share,  the  following 
variables  are  constants  or  have 
missing  correlations: 
shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 


Variables  Entered/Removecf 


Model 

Variables 

Entered 

Variables 

Removed 

Method 

1 

whatproce 

ss-SWEng 

Suppt 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

a-  Dependent  Variable:  goal_rslt_risk_share 


Model  Summary 


Model 

R 

R  Square 

Adjusted 
R  Square 

Std.  Error 
of  the 
Estimate 

Change  Statistics 

R  Square 
Change 

F  Change 

dfl 

df2 

Sig.  F 
Change 

1 

.273a 

.075 

.075 

4.687 

1 

58 

.035 

a. Predictors:  (Constant),  whatprocess-SWEngSuppt 


ANOVAb 


Model 

1 

df 

Mean 

Square 

F 

Hi 

1  Regression 

4.011 

1 

IBUII 

4.687 

.035a 

Residual 

49.639 

58 

Total 

53.650 

59 

m 

a-  Predictors:  (Constant),  whatprocess-SWEngSuppt 
b  Dependent  Variable:  goal_rslt_risk_share 
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Coefficients' 


Unstandardized 

Coefficients 

Standardi 

zed 

Coefficien 

ts 

Model 

B 

Std.  Error 

Beta 

t 

Sig. 

1  (Constant) 

2.861 

.154 

18.556 

O 

O 

whatprocess- 

SWEngSuppt 

-.528 

.244 

-.273 

-2.165 

.035 

a-  Dependent  Variable:  goal_rslt_risk_share 
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Regression 

Warnings 

For  models  with  dependent  variable 
goaLrslt_staff__stab!e,  the  following 
variables  are  constants  or  have 
missing  correlations: 
enterprise-manufact, 
shrink-entertainment, 
whatprocess-none.  They  will  be 
deleted  from  the  analysis. _ 
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Variables  Entered/Removed 


Variables 

Variables 

Model 

Entered 

Removed 

Method 

i 

whatproce 

ss-mainte 

nance 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

2 

whatproce 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

ss-CM 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

3 

whatproce 

ss-reengin 

eering 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 
.100). 

4 

whatprodu 

Stepwise 
(Criteria: 
Probabilit 
y-of-F-to-e 
nter  <= 

cts-none 

.050, 
Probabilit 
y-of-F-to-r 
emove  >= 

.100). 

a  Dependent  Variable:  goal_rslt_staff_stable 


Appendix  B:  Regression  for  Outsourcing  Goals 


205 


Model  Summary 


Model 

R 

R  Square 

Adjusted 
R  Square 

Std.  Error 
of  the 
Estimate 

Change  Statistics 

R  Square 
Change 

F  Change 

dfl 

df2 

Sig.  F 
Change 

1 

.280a 

.079 

.063 

.6638 

.079 

4.943 

1 

58 

.030 

Ep 

,477b 

.228 

.201 

.6129 

.149 

11.027 

1 

57 

.002 

.533° 

.284 

.245 

.5955 

mm 

4.374 

1 

56 

.041 

■ 

.580d 

.336 

.288 

.5785 

mm 

4.341 

1 

55 

.042 

a.  Predictors:  (Constant),  whatprocess-maintenance 

b.  Predictors:  (Constant),  whatprocess-maintenance,  whatprocess-CM 

c.  Predictors:  (Constant),  whatprocess-maintenance,  whatprocess-CM,  whatprocess-reengineerin 

d.  Predictors:  (Constant),  whatprocess-maintenance,  whatprocess-CM,  whatprocess-reengineerin 
whatproducts-none 


ANOVAe 


Model 

df 

Mean 

Square 

F 

m 

1 

Regression 

2.178 

1 

4.943 

,030a 

Residual 

25.556 

58 

1  Wk ' 

Total 

27.733 

59 

1 

2 

Regression 

6.320 

2 

3.160 

8.412 

.001 b 

Residual 

21.413 

57 

.376 

Total 

27.733 

59 

3 

Regression 

7.871 

7.398 

,000c 

Residual 

19.862 

Total 

27.733 

4 

Regression 

9.325 

4 

2.331 

6.965 

,000d 

Residual 

18.409 

55 

.335 

Total 

27.733 

59 

a.  Predictors:  (Constant),  whatprocess-maintenance 

b.  Predictors:  (Constant),  whatprocess-maintenance,  whatprocess-CM 

c.  Predictors:  (Constant),  whatprocess-maintenance,  whatprocess-CM, 
whatprocess-reengineering 

d.  Predictors:  (Constant),  whatprocess-maintenance,  whatprocess-CM, 
whatprocess-reengineering,  whatproducts-none 

e  Dependent  Variable:  goal_rslt_staff_stable 
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Coefficients? 


Unstandardized 

Coefficients 

Standardi 

zed 

Coefficien 

ts 

Model 

B 

Std.  Error 

Beta 

t 

Sig. 

1 

(Constant) 

2.778 

.111 

25.108 

.000 

whatprocess-maint 

enance 

.389 

.175 

.280 

2.223 

.030 

2 

(Constant) 

2.851 

.105 

27.280 

.000 

whatprocess-maint 

enance 

.673 

.183 

.485 

3.682 

.001 

whatprocess-CM 

-.660 

.199 

-.437 

-3.321 

.002 

3 

(Constant) 

2.813 

.103 

27.259 

.000 

whatprocess-maint 

enance 

.657 

.178 

.474 

3.698 

.000 

whatprocess-CM 

-.770 

.200 

-.510 

-3.848 

.000 

whatprocess-reeng 

ineering 

.455 

.218 

.249 

2.091 

.041 

4 

(Constant) 

2.776 

.102 

27.275 

.000 

whatprocess-maint 

enance 

.685 

.173 

.493 

3.953 

.000 

whatprocess-CM 

-.759 

.195 

-.503 

-3.903 

.000 

whatprocess-reeng 

ineering 

.469 

.211 

.257 

2.217 

.031 

whatproducts-none 

1.224 

.587 

.230 

2.084 

.042 

a  Dependent  Variable:  goal_rslt_staff_stable 
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Software  Outsourcing  —  Study  Objectives 


We  are  researchers  in  the  Arizona  State  University’s  Computer  Science  and  Engineering  Department  who  are 
investigating  software  development  outsourcing.  According  to  published  accounts,  software  development 
outsourcing  has  become  commonplace  and  often  meets 
organizational  goals.  Unfortunately,  nearly  30%  of  outsourcing 
relationships  end  poorly  (anything  from  general  dissatisfaction  to 
legal  action). 

With  your  assistance,  we  hope  to  identify  software  outsourcing 
strategies,  motivations,  benefits,  drawbacks,  and  relevant  project 
situation  variables.  This  information  will  help  us  to  discern  why 
outsourcing  efforts  succeed  or  fail  to  meet  goals  and  which  strategies 


Definition 

Software  development  outsourcing: 

hiring  of  vendors  to  perform  software 
development  activities  or  develop  a 
portion  of  an  overall  software  product. 
It  does  not  include  the  hiring  of 
temporary  employees. 


are  most  appropriate  for  specific  projects  and  goals.  Using  this  knowledge,  we  will  produce  a  process  simulation 
tool  which  will  allow  researchers  and  project  managers  to  more  closely  study  the  inter-organizational  relations 
within  a  planned  outsourcing  relationship  and  their  impact  on  the  overall  software  development  process.  A  second 
tool,  for  decision  support,  will  then  be  constructed  to  aid  software  development  project  managers  and  consultants  in 
making  software  outsourcing  strategy  decisions  for  specific  projects. 


Who  can  help? 

You  can  help  by  completing  this  brief  survey  if,  within  the  last  2  years,  you  have  participated  in  a  software 
development  project  where  any  portion  of  the  product  development  or  effort  has  been  contracted  to  an  outside 
vendor  (regardless  of  which  side  of  the  relationship  you  worked  on).  This  survey  includes  questions  about  your 
background,  your  most  recent  software  outsourcing  project,  and  general  outsourcing  experience  over  the  past  five 
years.  The  questionnaire  is  designed  to  take  less  than  15  minutes  to  complete. 


What  do  I  get  for  helping? 

If  you  choose  to  participate,  your  answers  will  be  held  in  the  strictest  confidence.  Only  our  research  team  will  see 
your  individual  answers.  Our  reports  will  consist  of  summaries  of  data  from  all  respondents.  When  completed 
(planned  for  late  spring  1999),  these  summary  reports  will  be  available  to  survey  participants  via  our  outsourcing 
website  (http://www.eas.asu.edu/-outsrc/).  If  you  provide  the  optional  contact  information,  you  will  be  notified 
when  survey  results  are  posted  and  will  be  provided  with  free  copies  of  the  decision  support  tools  when  they 
become  available. 


Feel  free  to  contact  us  with  any  questions  you  might  have  regarding  our  research.  Thank  you  for  your  assistance. 


Brian  G.  Hermann 

PhD.  Candidate 

Department  of  Computer  Science  and  Engineering 
Arizona  State  University 
brian.hermann@asu.edu 


Stephen  T.  Roehling 

Master's  Candidate 

Department  of  Computer  Science  and  Engineering 
Arizona  State  University 
roehling@imap3.asu.edu 
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I.  Instructions 


1 .  For  the  purposes  of  this  study,  we  define  software  development  outsourcing  as  the  hiring  of  vendors  to  perform 
software  development  activities  or  to  develop  a  portion  of  a  software  product.  It  does  not  include  the  hiring  of 
temporary  employees. 

2.  Please  answer  every  question.  Some  questions  may  look  like  others,  but  each  one  is  different. 

3.  There  are  no  right  or  wrong  answers.  Please  provide  a  realistic  assessment  of  each  item  based  on  your 
experiences.  The  focus  of  the  survey  is  on  your  experience,  not  on  what  you  wish  were  true  or  what  may  be  true 
in  the  future. 

4.  For  questions  pertaining  to  this  survey  please  contact  Brian  Hermann  via  e-mail  at  brian.hermann@asu.edu. 

5.  Please  return  this  survey  to: 

Brian  G.  Hermann 

Computer  Science  and  Engineering  Department 
College  of  Engineering  and  Applied  Sciences 
Arizona  State  University 
Box  875406 

Tempe,  AZ  85287-5406,  U.S.A. 

6.  Please  remove  this  page  for  your  information  and  continue  with  the  survey. 


Confidentiality 


Your  responses  to  this  survey  are  confidential.  As  summarized  below,  no  organization  or  individual 
respondent  will  be  identified  by  name  in  any  analyses  or  report  without  your  written  permission. 

PUBLIC  LAW  93-759,  entitled  the  Privacy  Act  of  1974  requires  that  all  individuals  be  informed  of  the  purposes  and 
uses  to  be  made  of  the  information  which  is  solicited.  The  following  is  furnished  to  explain  why  the  information  is 
requested  and  the  general  uses  to  which  the  information  may  be  put. 


Purpose:  This  study  strives  to  examine  software  outsourcing  strategies,  motivations,  benefits,  drawbacks,  and 
relevant  project  situation  variables.  The  survey  results  will  be  used  both  to  better  understand  software  outsourcing, 
as  well  as  to  develop  a  software  outsourcing  process  simulation  tool. 


Uses:  Survey  data  are  used  for  research  purposes  only.  Individual  responses  are  confidential.  Only  summarized  data 
will  be  reported  to  you,  if  you  so  request,  and  academic  audiences. 


Effects  of  Non-Disclosure:  Participation  in  the  study  is  voluntary.  No  penalty  will  be  imposed  for  failure  to 
respond  to  any  particular  question. 
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II.  Background  Information _ 

1.  How  many  software  development  projects  involving  outsourcing  have  you  participated  in  during  the  past 

five  years?  _ Projects 

2.  Roughly,  what  portion  of  your  organization’s  software  development  has  been  outsourced  during  the  past 

five  years?  _ % 

3.  The  final  result  of  this  research  will  be  a  suite  of  software  tools  to  help  practitioners  in  various  roles 
evaluate  software  outsourcing  strategies  and  better  understand  software  outsourcing  dynamics  and 
constraints.  Would  these  types  of  tools  be  helpful  to  you? 

□  Yes  □  No 

Why  or  Why  Not? _ 


4.  In  the  future,  would  you  like  to  be  contacted  to  have  the  opportunity  to  provide  inputs  to  other  software 
outsourcing  research  questionnaires  and  to  receive  copies  of  the  software  outsourcing  decision  support 
and  simulation  tools? 

□  Yes  □  No 

5.  Please  provide  your  name  and  best  method  of  contact  (all  results  will  be  kept  confidential) 


Name 

Electronic  mail 

Telephone 

( 

) 

extension 

Standard  Mail 

III.  Most  Recent  Software  Development  Outsourcing  Project  Experience 

Please  answer  the  following  questions  for  the  most  recent  software  outsourcing  project  that  you  worked  on 
(within  the  last  2  years).  If  you  have  worked  on  multiple  projects  recently,  please  answer  the  questions 
utilizing  the  project  about  which  you  have  the  most  knowledge. 


6. 


♦ 

□ 

□ 

□ 

□ 

□ 


What  type  of  software  was  developed  in  this  project?  Please  check  application  area  (domain)  and/or 


project  type. 

Systems  software,  e.g.: 

♦ 

Shrink-wrap  commercial/consumer  software 

Avionics 

products,  e.g.: 

Embedded  controllers  and  firm- ware 

□ 

Entertainment 

Communications  systems 

□ 

Business  productivity 

Device  drivers 

□ 

Utilities 

Other: 

□ 

Internet 

□ 

Other: 

♦  Software  component  development,  e.g.: 

□  Domain  frameworks 

□  CASE  tools 

□  Class  libraries 

□  Operating  systems 

□  Development  tools 

□  Other:  _ 


♦  Enterprise  software  development  and 
package  customization,  e.g.: 

□  Accounting  systems 

□  Manufacturing  requirements  planning 

□  Payroll  systems 

□  Order  Entry  System 

□  Scripting  and  extensions  development 

□  Interactive  web-site  development 

□  Other: 
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7. 


□ 

□ 

□ 

□ 

□ 

□ 

a 

a 

□ 


Which  software  development  process  components  or  activities  were  outsourced  on  this  project?  (Select  all 
that  apply) 


Requirements 

Design 

Testing 

Maintenance 

Reengineering 

Application  support  (for  enterprise  systems) 
Training  (e.g.,  languages,  processes) 
Specification 
Documentation 


□  Coding 

□  Fielding 

□  Configuration  management 

Q  Tools  support  (e.g.,  requirements  database, 
version  control  tool) 

□  Software  engineering  support  (e.g.,  code 
reviews,  SEI  reviews,  quality  reviews) 

□  None 

□  Other  (please  list) _ 


How  would  you  describe  the  process  components  you  outsourced? 


8.  Which  product  components  were  outsourced  during  this  software  development? 

□  Custom  (specialized) 

□  Common  application  (off  the  shelf) 

□  Common  application  (customized  version  of  an  available  component) 

□  None 

□  Other  (please  list)  _ _ 


How  would  you  describe  the  product  components  you  outsourced? 
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9.  With  respect  to  in-house  development,  what  project  goals  (motivations  for  outsourcing)  were  part  of  the 
decision  to  outsource  software  development  for  this  project? 


Please  note  there  are  two  parts  to  this  question: 

a.  Estimate  the  importance  of  each  goal  using  the  importance  scale  and  the  blanks  to  the  left  of  each  goal. 

b.  Estimate  the  degree  to  which  these  goals  were  realized  by  the  selected  outsourcing  strategy  -  circle  the 
appropriate  number  on  the  scale  to  the  right  of  each  goal. 


Not  Important 

1  2 

Importance  Scale 

Somewhat  Important 

3 

4 

Importance  Goals 

Significantly 
Worse  than 
Expectations 

Costs  &  Schedule 

a.  Reduce  project  costs  by  taking  advantage  of 

outsourcing  vendor's  economies  of  scale .  *  ^ 

b.  Reduce  development  schedule  —  a  vendor  can 

complete  the  job  faster  than  our  in-house  team .  1  2 

c.  Reduce  development  schedule  —  parallel  activities 

from  dividing  the  effort  speeds  up  the  overall  1  2 

schedule . 

d.  Cash  flow  from  sale  of  the  outsourced  product's 

distribution  rights  to  the  outsourcing  vendor .  *  ^ 


Very  Important 
5 


Exactly  on 
Target 


Significantly 
Better  than 
Expectations 


3  4  5 

3  4  5 

3  4  5 

3  4  5 


Personnel 

e.  Acquire  expertise  not  available  within  the  internal 

organization  (e.g.  domain,  language,  tool,  etc.) . 

f.  Add  more  personnel  to  the  project  (necessary  due  to 

an  insufficient  in-house  capacity) . 

g.  Add  more  personnel  to  fill  a  short-term,  part-time  or 


transient  need  for  effort  (e.g.,  only  for  fielding  at  the  ] 
end  of  the  project) . 

h.  Outsource  ‘non-core’  activities .  1 

i.  Control  over  outsourced  project  management 

process .  1 

j.  Improved  response  to  customer  objectives .  1 

k.  Improved  response  to  organizational  objectives  and 

strategies .  ^ 

l.  Keep  in-house  staffing  levels  more  stable .  1 

General 

m.  Risk  sharing  or  reduction  of  likelihood  and/or 

consequence  (e.g.,  technical,  cost) .  ^ 

n.  Product  quality  improvement .  1 


2  3 

2  3 

2  3 

2  3 

2  3 

2  3 

2  3 

2  3 


2  3 

2  3 


4  5 

4  5 

4  5 

4  5 

4  5 

4  5 

4  5 

4  5 


4  5 

4  5 


Other  (please  list) 

o. 


P- 


q- 


1  2  3  4  5 
1  2  3  4  5 
1  2  3  4  5 
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10.  What  were  the  consequences  of  outsourcing  in  this  project  in  comparison  to  similar  in-house  efforts? 
(Put  the  appropriate  number  from  the  consequence  scale  in  the  blank  next  to  each  factor) 

Decreased  Decreased  Decreased  No  Increased  Increased  Increased 

Dramatically  Significantly  Slightly  Change  Slightly  Significantly  Dramatically 

1  2  3  4  5  6  7 

_  a.  Project  costs 

_  b.  Development  schedule  (vendor  outsourcing  compared  to  in-house) 

_  c.  Intellectual  capital  (your  organization's  rights  to  the  developed  software  product) 

d.  Scheduling  flexibility  (including  ability  to  respond  to  immediate  needs  such  as  a  late  project 
-  productivity  burst) 

_  e.  Administrative  overhead 

_  f.  Control  over  outsourced  project  management  process 

_  g.  In-house  effort  spent  on  ‘non-core’  activities 

_  h.  In-house  personnel  turnover 

_  i.  Project  learning  curve  (time  required  to  become  productive  on  the  project) 

_ j.  Development  risks 

_  k.  Product  quality 

_  1.  Rework 

m.  Visibility  into  software  development  process  (ability  to  ascertain  development  progress,  adherence  to 
-  process  standards,  and  product  quality) 

n.  Control  over  final  product 

_  o.  Costs  associated  with  design  or  requirements  changes 

_  p.  Cultural,  location,  and  language  problems 

_  q.  Turf  wars  (e.g.  finger  pointing  between  development  groups  —  either  in-house  or  vendors) 

_  r.  Likelihood  of  a  failed  or  cancelled  project 

_  s.  Response  to  customer  objectives 

_  t.  Response  to  organizational  objectives  and  strategies 

Other  (please  list  any  other  outsourcing  consequences  not  already  shown  --  include  impact  rating  if 
appropriate) 

-  u. 


v. 


w. 
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11.  On  this  project  who  (or  what  project  roles)  drove  outsourcing  decision  making?  (Select  all  that  apply) 


Outsourcing  Customer  (organization  which 
hires  and  outside  vendor  to  develop  software) 

□  Project  manager 

□  Contract  officer 

□  Technical  lead 

□  Software  developer 

□  Corporate  management  policy 

□  Corporate  management  (one-time  decision) 

□  Management  consultant  working  for  an 
outsourcing  customer 

□  Other  (Please  Explain) _ 


Outsourcing  Vendor  (organization  which 
develops  software  for  another  organization) 

□  Project  manager 

□  Contract  officer 

□  Technical  lead 

□  Software  developer 

□  Other  (Please  Explain) _ 


12. 


□ 

□ 

□ 

□ 

□ 

□ 


What  role(s)  did  you  play  in  this  software  outsourcing  relationship?(Select  all  that  apply) 


Outsourcing  Customer  (organization  which 
hires  and  outside  vendor  to  develop  software) 

Project  manager 
Contract  officer 
Technical  lead 
Software  developer 

Management  consultant  working  for  an 
outsourcing  customer 

Other  (Please  Explain) _ 


Outsourcing  Vendor  (organization  which 
develops  software  for  another  organization) 

□  Project  manager 
Q  Contract  officer 

□  Technical  lead 

□  Software  developer 

□  Other  (Please  Explain) _ 
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IV.  General  Outsourcing  Experience _ 

Instructions  -  Consider  outsourcing  projects  you’ve  worked  on  in  the  last  five  years. 

13.  Based  upon  your  experience,  identify  your  level  of  agreement  with  the  following  assertions  about 
software  development  outsourcing. 

(Put  the  appropriate  number  from  the  scale  in  the  blank  next  to  each  assertion) 

Agreement  Scale 


Strongly  Disagree 

1  2 

Neither  Agree  Nor  Disagree 

3 

4 

Strongly  Agree 

5 

Project  Assertions 

□  Outsourcing  portions  of  larger  software  development  projects  is  more  successful  than  outsourcing 
portions  of  smaller  software  development  projects. 

□  Larger  outsourcing  efforts  are  more  successful  than  smaller  outsourcing  efforts. 

□  Outsourcing  development  of  software  in  some  domains  is  more  successful  than  outsourcing 
development  of  software  in  other  domains. 

□  Outsourcing  development  of  software  in  a  domain  familiar  to  the  buyer  (in-house  organization)  is 
more  successful  than  outsourcing  development  of  software  in  an  unfamiliar  domain. 

□  Outsourcing  development  of  software  in  a  domain  familiar  to  the  vendor  is  more  successful  than 
outsourcing  development  of  software  in  a  domain  with  which  the  vendor  is  unfamiliar. 

□  Outsourcing  development  of  software  is  more  successful  when  more  vendors  are  available  in  the 
project  domain. 

□  Outsourcing  development  of  software  is  more  successful  when  the  software  vendor  has  more 
experience  with  tools  or  languages. 

□  Outsourcing  development  of  software  is  more  successful  when  the  software  vendor  has  reusable 
design  or  code  components. 

Buyer-Seller  Relationship  and  Contract  Assertions 

□  Outsourcing  projects  with  frequent  reviews  and  inspections  are  more  successful  than  outsourcing 
projects  with  less  frequent  reviews  and  inspections. 

□  Outsourcing  project  success  is  closely  related  to  payment  strategies  and  incentives  in  the  vendor 
contract  (e.g.,  fixed-price  contracts  projects  are  more  or  less  successful  than  cost-plus  type  contracts). 

□  Outsourcing  project  success  is  closely  tied  to  the  form  of  communication  between  the  buyer  and 
vendor  (forms  of  communication  include  formal  letters,  e-mail,  telephone  conversations,  face-to-face 
meetings,  etc.). 

□  Outsourcing  projects  are  more  successful  when  the  buyer  has  more  visibility  into  the  vendor's 
development  process. 

□  Outsourcing  projects  are  more  successful  when  the  buyer  and  vendor  are  located  nearby. 

□  Outsourcing  projects  are  more  successful  when  the  buyer  and  vendor  are  located  far  apart  (such  as 
"off-shore"  arrangements)  because  time  differences  increase  the  collaborative  work  day  length. 

□  Outsourcing  projects  are  more  successful  when  the  buyer  and  vendor  have  previously  worked 
together  successfully. 

□  Outsourcing  development  of  software  is  more  successful  when  the  software  vendor  has  a  higher 
process  maturity  (e.g.  SEI  CMM  rating). 

□  Outsourcing  development  of  software  is  more  successful  when  the  buyer  has  a  higher  process 
maturity  (e.g.  SEI  CMM  rating). 

□  Outsourcing  development  of  software  is  more  successful  when  the  vendor  has  a  successful  track 
record. 
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(Question  13  Continued)  Based  upon  your  experience,  identify  your  level  of  agreement  with  the  following 
assertions  about  software  development  outsourcing. 

(Put  the  appropriate  number  from  the  scale  in  the  blank  next  to  each  assertion) 

Agreement  Scale 

Strongly  Disagree  Neither  Agree  Nor  Disagree  Strongly  Agree 

_ 1 _ 2 _ 3 _ 4 _ 5 _ 

Goal  and  Expectation  Assertions 

s.  Outsourcing  projects  with  more  aggressive  cost  reduction  goals  are  less  likely  to  be  successful  than 

-  those  with  more  modest  cost  reduction  goals. 

t.  Outsourcing  projects  with  more  aggressive  cost  reduction  goals  are  more  likely  to  be  successful  than 

-  those  with  more  modest  cost  reduction  goals. 

u.  Outsourcing  projects  with  more  aggressive  schedule  duration  reduction  goals  are  less  likely  to  be 

-  successful  than  those  with  more  modest  schedule  duration  reduction  goals. 

v.  Outsourcing  projects  with  more  aggressive  schedule  duration  reduction  goals  are  more  likely  to  be 

-  successful  than  those  with  more  modest  schedule  duration  reduction  goals. 

Product  Assertions 

_  w.  Outsourcing  development  of  software  is  more  successful  when  the  system  is  not  complex. 

x.  Outsourcing  development  of  software  is  more  successful  when  the  system  can  be  easily  divided  into 
-  components  (highly  modular). 

Other  Assertions  (please  list) 

_  y- 

z. 


aa. 
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14.  Based  on  your  experience,  identify  your  level  of  agreement  with  each  of  the  following  assertions  about 
which  factors  determine  whether  product  component  outsourcing  will  be  successful. 

(Put  the  appropriate  number  from  the  scale  in  the  blank  next  to  each  assertion) 

Agreement  Scale 

Strongly  Disagree  Neither  Agree  Nor  Disagree  Strongly  Agree 

1  2  3  4  5 


—  a.  Outsourcing  larger  components  is  generally  more  successful  than  outsourcing  smaller  components. 

_  b.  Outsourcing  smaller  components  is  generally  more  successful  than  outsourcing  larger  components. 

c.  Outsourcing  components  of  highly  modular  products  is  generally  more  successful  than  outsourcing 
components  of  monolithic  products. 

_  d.  Outsourcing  is  more  successful  when  the  interfaces  for  an  outsourced  component  are  well-defined. 

e.  Outsourcing  is  more  successful  when  the  tools  and  languages  used  by  both  in-house  and  vendor 

developers  are  compatible. 

f.  Outsourcing  is  more  successful  when  an  outsourced  component's  requirements  are  well-defined  up- 

—  front. 

g.  Outsourcing  is  more  successful  when  the  vendor  and  buyer  organizations  communicate  well  and 
overcome  administrative  obstacles  to  solve  problems. 

Other  (please  list) 

h. 
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15.  Based  on  your  experience,  identify  your  level  of  agreement  with  each  of  the  following  assertions  about 
which  factors  determine  if  process  component  (development  activity)  outsourcing  will  be  successful. 

(Put  the  appropriate  number  from  the  scale  in  the  blank  next  to  each  assertion) 

Agreement  Scale 

Strongly  Disagree  Neither  Agree  Nor  Disagree  Strongly  Agree 

12  3  4  5 

a.  Outsourcing  is  more  successful  when  organizational  interfaces  and  responsibilities  are  well-defined 
than  when  organizational  interfaces  and  responsibilities  are  loosely  defined. 

b.  Outsourcing  is  more  successful  when  organizational  lifecycle  models  (e.g.  prototyping,  spiral, 
waterfall,  incremental)  used  by  both  the  vendor  and  buyer  are  the  same  rather  than  different. 

c.  Outsourcing  is  more  successful  when  tools  and  methods  allow  information  to  flow  easily  between  the 
vendor  and  in-house  organization. 

_  d.  Outsourcing  is  more  successful  when  the  vendor's  process  maturity  (e.g.  SEI  CMM  rating)  is  higher. 

e.  Outsourcing  is  more  successful  when  the  in-house  organization's  process  maturity  (e.g.  SEI  CMM 
rating)  is  higher. 

f.  Outsourcing  is  more  successful  when  the  buyer’s  and  vendor's  process  maturity  levels  (e.g.  SEI  CMM 
rating)  are  the  same  or  close  than  when  the  ratings  differ  greatly. 

Other  (please  list) 


16.  Do  you  have  any  general  comments  about  the  survey,  or  software  outsourcing  in  general? 


Appendix  D:  Assertion  Rules 


visibilit 
y  into 
the 

softwar 

e 

develo 

pment 

proces 

s 

turf 

wars 

IMP 

IMP 

schedu 

le 

flexibilit 

y _ 

rework 

respon 
sivenes 
s  to 

organiz 

ational 

objectiv 

es 

respon 
sivenes 
s  to 
custom 

er 

objectiv 

es 

t5  .S  | 

0)  c  § 

o  TO  O 

0.-52  cr> 

IMP 

IMP 

IMP 

IMP 

project 

costs 

IMP 

IMP 

product 

quality 

IMP 

likeliho 
od  of  a 
failed 
or 

cancell 

ed 

project 

IMP 

intellect 

ual 

capital 

in- 

house 

person 

nel 

turnove 

r 

in- 

house 
effort 
spent 
on  non¬ 
core 
activitie 

s 

IMP 

develo 

pment 

schedu 

le 

IMP 

IMP 

develo 

pment 

risks 

IMP 

IMP 

IMP 

cultural 

locatio 
n,  and 
langua 
ge 

proble 

ms 

costs 

associa 

ted 

with 

change 

s 

IMP 

control 

over 

project 

manag 

ement 

proces 

s 

control 

over 

final 

product 

WOR 

admini 

strative 

overhe 

ad 

Outsourcing 
development  of 
software  in  a 
domain  familiar 
to  the  buyer  (in- 
house 

organization) 

Outsourcing 
development  of 
software  in  a 
domain  familiar 
to  the  vendor 

Outsourcing 
development  of 
software  in  a 
project  domain 
with  many 
available 
vendors 

Outsourcing 
development  of 
software  to  a 
vendor  with  more 
experience  with 
tools  or 
languages. 

Outsourcing 
development  of 
software  to  a 
vendor  with 

Appendix  D:  Assertion  Rules  219 


Appendix  D:  Assertion  Rules  220 


visibiiit 
y  into 
the 

softwar 

e 

develo 

pment 

proces 

s 

IMP 

IMP 

WOR 

turf 

wars 

IMP 

schedu 

le 

flexibilit 

Y 

rework 

IMP 

respon 

sivenes 

sto 

organiz 

ationai 

objectiv 

es 

IMP 

WOR 

IMP 

respon 
sivenes 
s  to 
custom 

er 

objectiv 

es 

project 
learnin 
g  curve 

IMP 

project 

costs 

product 

quality 

likeiiho 
od  of  a 
failed 
or 

cancell 

ed 

project 

IMP 

intellect 

ual 

capital 

in- 

house 

person 

nel 

turnove 

r 

c  ® 

<1>  „  —  o  s 
«  t;  c  y  (u  > 

D  O  Q>  C  2  ■£ 

'  O  t  Q.C  o  O 
,bx:<D(0OO(0«) 

develo 

pment 

schedu 

le 

develo 

pment 

risks 

cultural 

locatio 

n,  and 

langua 

ge 

proble 

ms 

IMP 

WOR 

costs 

associa 

ted 

with 

change 

s 

control 

over 

project 

manag 

ement 

proces 

s 

WOR 

control 

over 

final 

product 

IMP 

admini 
st  rati  ve 
overhe 
ad 

appropriate 
forms  of 
communication 
can: 

Outsourcing 
projects  are 
more  successful 
when  the  buyer 
has  more 
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-  Shrinkwrap  -  Business  10.  Improved/Increased  0.867  Small  Positive 

_ Intellectual  Capital _  (Improving) 

-  Shrinkwrap  -  Utilities  10.  Improved/Increased  1.265  Moderate  Negative 
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O  0H 

^  g 


_ Flexibility _ (Improving) 

Outsourcing  Constant  1 1 .  Decreased  Likelihood  0.043  Small  Positive 

of  a  Failed  or  Cancelled  (Improving) 

Project 


Appendix  E:  Outsourcing  Decision  Rules  227 


Process  -  Reengineering  20.  Increased  Visibility  into  1.1  Moderate  Positive 

the  Software  Development  (Improving) 

_ Process _ 

Process  -  Reengineering  12.  Improved  Product  0.961  Small  Positive 
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Thank  you  for  participating  in  the  software  development  outsourcing  decision  support  tool  validation 
effort.  1  couldn’t  complete  this  work  without  your  assistance.  As  a  thank-you  for  completing  this  brief  scenario 
questionnaire,  you  will  receive  a  $10  gift  certificate  to  Amazon.com  and  the  decision  support  tool. 

You  can  complete  the  form  electronically  -  this  document  is  form-enabled,  so  you  can  simply  type  in 
the  text  boxes  and  click  on  the  check  boxes  and  return  it  via  e-mail  to  brian.hcrmann@computer.org 

-OR- 

You  can  print  the  form  and  return  it  by  mail  to: 

Brian  G.  Hermann 
16669  S  34*  Way 
Phoenix,  AZ  85048-7876 


Here  are  the  steps: 

1.  On  this  page  there  are  some  brief  background  questions  to  assess  your  software  and  outsourcing 
experience. 

2.  On  pages  two  through  five  are  outsourcing  project  scenarios  for  four  different  software  domains. 
If  you  have  experience  in  a  particular  software  domain,  simply  read  the  scenario  and  based  on 
your  experiences  determine  how  the  outsourcing  will  affect  the  project  consequences  as 
compared  to  a  completely  in-house  effort. 

■  Scenario  1  -  Enterprise  Software 

1  Scenario  2  -  Shrink-Wrap  Software 

■  Scenario  3  -  Software  Component  Development 

*  Scenario  4  -  Systems  Software 

3.  Complete  all  scenarios  for  which  you  have  relevant  experience. 

4.  Return  the  form  to  my  by  March  27,b,  2000  via  e-mail  or  regular  mail. 

Thank  you, 

-Brian  Hermann 


What  is  your  education  level? 


School 

Degree 

How  many  years  of  software  development  experience  do  you  have? 

How  long  have  you  been  outsourcing  software  development  (or  been  a  software  vendor)? 
How  many  outsource  projects  have  you  been  involved  with? 
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CM 


Comments  on  this  scenario: 


2.  Shrink-Wrap  Software  Outsourcing  Scenario:  Your  small  software  company  BizTools  has  several  popular  business 
applications  for  client  management  and  organization-wide  fax  routing.  Your  have  been  selected  to  manage  the  company’s  most  ambitious  effort  to  date  -  a 
network  capable  application  to  track  employee  location.  The  tentative  software  title  is  “Find  ‘Em”,  but  that  may  change  based  on  focus  group  analysis.  Your 
biggest  problem  is  that  you  don’t  have  enough  employees  to  meet  your  boss’  ambitious  release  date.  So  you’ve  decided  to  outsource  some  software  development 
processes  only.  Your  vendor,  TechStop,  will  supply  people  and  equipment  to  accomplish  the  various  processes  listed  below. 
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Comments  on  this  scenario: 
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Comments  on  this  scenario: 
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Comments  on  this  scenario: 
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